-- Logs begin at Sun 2022-08-28 00:10:42 UTC, end at Sun 2022-08-28 01:19:54 UTC. -- Aug 28 00:45:13.026252 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 00:45:13.035561 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 00:45:13 2022] *** Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: nodename: dv-osbrick-master-4-iscsi Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: machine: x86_64 Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: clock source: unix Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: pcre jit disabled Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: detected number of CPU cores: 4 Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: current working directory: / Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: detected binary path: /usr/bin/uwsgi-core Aug 28 00:45:13.037584 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: your processes number limit is 47680 Aug 28 00:45:13.038172 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: your memory page size is 4096 bytes Aug 28 00:45:13.038172 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: detected max file descriptor number: 2048 Aug 28 00:45:13.038172 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: lock engine: pthread robust mutexes Aug 28 00:45:13.038172 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: thunder lock: enabled Aug 28 00:45:13.038172 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 00:45:13.038172 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 00:45:13.078338 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: Python main interpreter initialized at 0x563790cc99c0 Aug 28 00:45:13.078338 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: python threads support enabled Aug 28 00:45:13.078338 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: your server socket listen backlog is limited to 100 connections Aug 28 00:45:13.078338 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: your mercy for graceful operations on workers is 90 seconds Aug 28 00:45:13.078703 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 00:45:13.078788 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: *** Operational MODE: preforking *** Aug 28 00:45:13.079037 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: *** uWSGI is running in multiple interpreter mode *** Aug 28 00:45:13.079037 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: spawned uWSGI master process (pid: 81569) Aug 28 00:45:13.079259 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 28 00:45:13.080497 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: spawned uWSGI worker 1 (pid: 81581, cores: 1) Aug 28 00:45:13.080497 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: spawned uWSGI worker 2 (pid: 81582, cores: 1) Aug 28 00:45:13.080497 dv-osbrick-master-4-iscsi devstack@keystone.service[81569]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 00:45:17.446010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:45:17.446010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: from cryptography.utils import int_from_bytes Aug 28 00:45:17.446820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:45:17.446820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: from cryptography.utils import int_from_bytes Aug 28 00:45:17.447306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:45:17.447306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: from cryptography.utils import int_from_bytes Aug 28 00:45:17.447448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:45:17.447448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: from cryptography.utils import int_from_bytes Aug 28 00:45:17.498815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:45:17.499013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:45:17.499134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:45:17.499242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] command line args: [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:45:17.499320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:45:17.499429 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] command line args: [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:45:17.499515 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:45:17.499638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ================================================================================ {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:45:17.499729 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:45:17.499905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ================================================================================ {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:45:17.499994 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] admin_token = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] admin_token = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] config_dir = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] config_dir = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] config_source = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500562 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500641 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] debug = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500719 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] config_source = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.500836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] debug = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501231 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.501986 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] list_limit = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502203 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] list_limit = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] log_config_append = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502404 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] log_config_append = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] log_dir = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] log_dir = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.502933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] log_file = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510185 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] log_file = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510455 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.510946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511818 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.511932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512042 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512524 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512813 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.512894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] publish_errors = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] publish_errors = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.513936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514017 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514090 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] standard_threads = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514166 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] standard_threads = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514239 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514310 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514386 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514618 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] use_journal = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] use_journal = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] use_json = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.514925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] use_json = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.515045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] use_stderr = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.515173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] use_stderr = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.515256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] use_syslog = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.515336 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] use_syslog = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.515414 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.515494 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:45:17.515573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.515652 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.515724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.515795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516639 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.516947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517103 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517181 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517254 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517550 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517621 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.517970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518566 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.518942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519266 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519351 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519661 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.519966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520254 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520549 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520772 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520851 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.520929 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521001 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521231 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521531 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521753 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521850 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.521945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522380 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522625 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.522982 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523288 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523925 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.523999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524256 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524868 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.524948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525067 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525309 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525743 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.525947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.526022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.526095 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.526211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.526788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.526852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.526976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527084 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527663 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527780 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.527974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528772 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528847 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.528926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.529926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530236 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530397 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.530897 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531487 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531561 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.531938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532158 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532310 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532457 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.532981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533124 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533774 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.533914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534177 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534438 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534593 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534732 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.534948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535242 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] auth.external = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535322 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] auth.external = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.535865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] auth.password = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536099 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] auth.password = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] auth.token = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] auth.token = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536474 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.536955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537035 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537184 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537521 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.537991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] credential.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538231 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] credential.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538718 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.538966 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539212 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539855 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.539941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540108 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540429 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.540955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.541118 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.541281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.541381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.541461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.541620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.541707 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.541913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.542032 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.542751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.542891 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543017 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543303 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543588 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.543978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544321 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544659 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544808 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.544968 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545373 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545600 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.545971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546218 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.546989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.547993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548468 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548692 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.548952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549106 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549188 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549696 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549848 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.549929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.550105 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.550185 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.550346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.550434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.550579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.550813 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.551050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.551192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.551348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.551495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.551628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.551762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.551908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552588 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.552971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553220 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553381 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553699 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.553933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554084 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554313 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.554866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.555015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.555156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.555270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.555353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.555505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.559758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.559880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560282 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560282 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560438 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560718 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.560953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561232 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561313 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561838 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.561958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562527 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562600 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.562986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563058 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563361 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563437 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563592 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.563980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564428 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564731 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564807 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.564953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565254 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565388 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565533 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.565977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566192 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566337 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566481 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566709 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.566927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567661 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.567965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] role.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.568871 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] role.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] role.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569343 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569509 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] role.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569740 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.569989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570238 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570562 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.570973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571230 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571311 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571475 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.571953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572445 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.572949 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.573143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.573408 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.573497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.573657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.573739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.573906 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574032 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574212 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574634 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.574932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.575889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576519 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576601 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.576988 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577461 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.577935 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578236 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578406 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.578965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.579146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.579231 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.579386 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.579466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.588604 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.588724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589487 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589635 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.589929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590155 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590473 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590555 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.connection = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590713 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.590943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.connection = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591468 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591468 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591823 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.591964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592040 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592244 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592392 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.592982 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593126 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:45:17.593412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:45:17.593412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:45:17.616931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.617156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.617371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.617479 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.617603 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.617826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.626323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.632365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.655146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.655390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.659315 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.659550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.726107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.726282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.783111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.783316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.783412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.783541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.947407 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.947687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.947858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.948082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.948832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.949326 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.949577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.949878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.950103 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.950320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.950535 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.976781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.976956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977044 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977421 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.977950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.978080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.978164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.978299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.989414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:17.989586 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.002301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.002534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.002762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.002847 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.002986 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003493 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003792 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.003934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.004151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:45:18.021079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.021290 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:45:18.021532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.021617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.021742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:45:18.021825 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:45:18.022078 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.022158 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.022304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:45:18.022394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.022576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.022659 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.022836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.023092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.023188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.023366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.033156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.033436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.033579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.033705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.033859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.033986 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.034131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.034413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.040932 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.041375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.043869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.044157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.044460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.044543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.044729 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.044812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.045912 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.046112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.046211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.046386 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.046489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.046657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.046760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.046927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.047224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.069305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.070064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.070762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.071045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.071541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.071825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.076439 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.076724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.077006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.077086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.077289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.077570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.083324 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.083607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.084024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.084308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.087782 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.088077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.088356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.088438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.088652 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.088759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.089511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.089593 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.089741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.089963 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.090077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.090243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.090340 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.092271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.092567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.093074 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.108792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.109073 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.109187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.112921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.113055 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.116152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.116238 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.116447 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.116581 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.120801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.121023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.123931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.124177 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.127285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.127464 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.127587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.127765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.127879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.128060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.128167 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.128343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.128596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.128698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.128849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.128940 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.145055 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.145206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.145344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.145493 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.145611 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.145758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.145875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.146028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.153330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.153430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.154966 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.155063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.156511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.156596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.156796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.156879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.159430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.159525 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.159717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.159800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.160010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.160106 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.160294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.160382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.160570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.160654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.171810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.172099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.172476 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.172560 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.172757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.172839 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.173036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.173121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.173315 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.173398 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.173595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.173686 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.173870 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.174154 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.188957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.189512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.191842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.192524 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.194705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.195413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.196192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.196857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.197832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.198659 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.198889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.198992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.199204 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.199496 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.205553 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.206185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.207086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.207762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.210162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.210461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.210695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.210781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.210995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.211090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.211304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.211595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.218961 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.219283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.219570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.219802 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.220361 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.220639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.226690 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.227024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.227284 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.227534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:45:18.227620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.227817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.228095 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.228182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.228376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.228460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.228648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.228741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.228917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.229000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.229185 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.229269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.229987 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.230076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.230260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.230445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.230529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.230721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.230967 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.231053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.231276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.231565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.231830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:45:18.265458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563790cc99c0 pid: 81582 (default app) Aug 28 00:45:18.265694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563790cc99c0 pid: 81581 (default app) Aug 28 00:45:18.268802 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0bbc-5149-47ba-b2f6-85c9e9f7dbaf None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:18.269123 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0bbc-5149-47ba-b2f6-85c9e9f7dbaf None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:18.269430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0bbc-5149-47ba-b2f6-85c9e9f7dbaf None None] PATH_INFO: `/v3` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:18.273614 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Sun Aug 28 00:45:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:25.648396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc94e-70e1-44fb-8400-c582a2787998 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.648915 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc94e-70e1-44fb-8400-c582a2787998 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.648986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc94e-70e1-44fb-8400-c582a2787998 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.653951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:25.659462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.659908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.660001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.732763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: INFO dbcounter [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] Registered counter for database keystone Aug 28 00:45:25.753036 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG oslo_db.sqlalchemy.engines [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:45:25.759406 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writer thread running {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:45:25.942638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG passlib.handlers.bcrypt [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81582) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:45:25.942983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG passlib.handlers.bcrypt [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81582) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:45:25.999052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:26.000688 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:26.131438 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 00:45:26.578664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc94e-70e1-44fb-8400-c582a2787998 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.648889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: INFO dbcounter [None req-048cc94e-70e1-44fb-8400-c582a2787998 None None] Registered counter for database keystone Aug 28 00:45:26.672144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG oslo_db.sqlalchemy.engines [None req-048cc94e-70e1-44fb-8400-c582a2787998 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:45:26.678456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writer thread running {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:45:26.795027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc94e-70e1-44fb-8400-c582a2787998 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.799318 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aaea8-a5eb-4c4c-970e-d39a7afc183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.799935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aaea8-a5eb-4c4c-970e-d39a7afc183f admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.800211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aaea8-a5eb-4c4c-970e-d39a7afc183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.800480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aaea8-a5eb-4c4c-970e-d39a7afc183f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.809162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aaea8-a5eb-4c4c-970e-d39a7afc183f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.861261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cf6aaea8-a5eb-4c4c-970e-d39a7afc183f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:45:26.861534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aaea8-a5eb-4c4c-970e-d39a7afc183f admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.871729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:45:26.877837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.892752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d5707-ada5-45e9-b541-13d2b761a7f0 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.897247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112800f9-3915-49b2-95f1-9103b013d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.898341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112800f9-3915-49b2-95f1-9103b013d550 admin admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.898619 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112800f9-3915-49b2-95f1-9103b013d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.898897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112800f9-3915-49b2-95f1-9103b013d550 admin admin] PATH_INFO: `/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.900517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112800f9-3915-49b2-95f1-9103b013d550 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4a5e2ed24234c04bb44f2eb019170b1)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.954040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING keystone.common.rbac_enforcer.enforcer [None req-112800f9-3915-49b2-95f1-9103b013d550 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:45:26.954374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112800f9-3915-49b2-95f1-9103b013d550 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.958971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:28.845739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffe66e-5242-462d-b4a5-451d92e9f17c None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.846231 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffe66e-5242-462d-b4a5-451d92e9f17c None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.846314 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffe66e-5242-462d-b4a5-451d92e9f17c None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.850371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:28.856352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0ff5-9478-417d-841c-e13719b83521 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.856812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0ff5-9478-417d-841c-e13719b83521 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.856901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0ff5-9478-417d-841c-e13719b83521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.876859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e7ea0ff5-9478-417d-841c-e13719b83521 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:28.878385 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e7ea0ff5-9478-417d-841c-e13719b83521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:28.886210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 28 00:45:29.154934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffe66e-5242-462d-b4a5-451d92e9f17c None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.166975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffe66e-5242-462d-b4a5-451d92e9f17c None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.171227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75371347-7b02-4319-b7f1-58d0dc2e7263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.171818 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75371347-7b02-4319-b7f1-58d0dc2e7263 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.172091 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75371347-7b02-4319-b7f1-58d0dc2e7263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.172362 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75371347-7b02-4319-b7f1-58d0dc2e7263 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.179959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75371347-7b02-4319-b7f1-58d0dc2e7263 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.181720 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75371347-7b02-4319-b7f1-58d0dc2e7263 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.190394 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:45:29.195828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0ff5-9478-417d-841c-e13719b83521 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.205687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0ff5-9478-417d-841c-e13719b83521 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.210033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f321bd5-828e-451a-a37b-e452822063ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.210654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321bd5-828e-451a-a37b-e452822063ad admin admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.210933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321bd5-828e-451a-a37b-e452822063ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.211240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f321bd5-828e-451a-a37b-e452822063ad admin admin] PATH_INFO: `/v3/users/00caaefe5f7440c9962342f8ae00dd35` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.212548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f321bd5-828e-451a-a37b-e452822063ad admin admin] RBAC: Authorizing `identity:get_user(user_id=00caaefe5f7440c9962342f8ae00dd35)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.215290 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f321bd5-828e-451a-a37b-e452822063ad admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.216817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/users/00caaefe5f7440c9962342f8ae00dd35 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:31.192055 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb02a7-36a9-4f11-b4ee-788fa18a7499 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.192564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb02a7-36a9-4f11-b4ee-788fa18a7499 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.192649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb02a7-36a9-4f11-b4ee-788fa18a7499 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.193966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:31.199768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83c7a-18f9-4db3-8fa0-7dcfd87208ab None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.200187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83c7a-18f9-4db3-8fa0-7dcfd87208ab None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.200321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83c7a-18f9-4db3-8fa0-7dcfd87208ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.218047 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-57f83c7a-18f9-4db3-8fa0-7dcfd87208ab None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:31.219252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-57f83c7a-18f9-4db3-8fa0-7dcfd87208ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:31.232313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b1015-f319-4619-8c57-7288e9fa99b6 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.232597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b1015-f319-4619-8c57-7288e9fa99b6 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.232898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b1015-f319-4619-8c57-7288e9fa99b6 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.234257 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:31.239673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.239963 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.240248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.284176 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG passlib.handlers.bcrypt [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81581) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:45:31.284618 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG passlib.handlers.bcrypt [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81581) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:45:31.304132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:31.330983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:31.332644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:31.437259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:31.581444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83c7a-18f9-4db3-8fa0-7dcfd87208ab None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.605824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.688033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83c7a-18f9-4db3-8fa0-7dcfd87208ab None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.710696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.721771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.722424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.722705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.722987 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.735384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:31.743913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:31.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:31.747162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:31.751445 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.814491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6b1f-1f77-4c5b-a576-24298be835b5 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.816819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.834074 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.852810 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.853216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3c2e1-b440-47cf-bf17-24f48769053a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.853708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.854987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.855307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.888271 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.888918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.889451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.889944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.891009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:31.892133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.893537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.906261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:31.911858 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.927354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.928913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.014950 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01c6e-55cd-45eb-8aed-859fb36098b2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.029357 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:45:32.035070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.038005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.051061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.051727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.052005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.052280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] PATH_INFO: `/v3/users/00caaefe5f7440c9962342f8ae00dd35` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.053478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] RBAC: Authorizing `identity:get_user(user_id=00caaefe5f7440c9962342f8ae00dd35)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.054950 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.056597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/users/00caaefe5f7440c9962342f8ae00dd35 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:32.062497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.077029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.135990 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e715b-0b12-4a98-9ee1-e8394a73ee97 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.162643 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42122-ac11-41bc-b3a4-f523f26c355a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.170385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.171270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.171546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.171840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.190874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.192394 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.199067 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.199804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.200306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.200378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.201459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.202905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.204492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 10/18] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:32.210398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:32.212725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:32.213805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:32.214647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:32.214647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:32.214647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:32.214647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 9/19] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:32.220690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.279272 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.292955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.312060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ea61-e1d4-4193-ac99-0e5e60eec2c8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.325614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90109-2ed4-40fb-b61b-248b6c7bfb8e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.349506 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb6f7-e594-4531-8909-d7446d541d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.350118 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb6f7-e594-4531-8909-d7446d541d14 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.350395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb6f7-e594-4531-8909-d7446d541d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.350674 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb6f7-e594-4531-8909-d7446d541d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.351430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb6f7-e594-4531-8909-d7446d541d14 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.domain.id=default, user.id=00caaefe5f7440c9962342f8ae00dd35) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:32.351739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb6f7-e594-4531-8909-d7446d541d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.353192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb6f7-e594-4531-8909-d7446d541d14 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.360004 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/role_assignments?user.id=00caaefe5f7440c9962342f8ae00dd35&scope.domain.id=default&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:32.360887 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a3e0e-d7a0-4309-9aa9-b828ceaca4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.361506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3e0e-d7a0-4309-9aa9-b828ceaca4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.361786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3e0e-d7a0-4309-9aa9-b828ceaca4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.362060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a3e0e-d7a0-4309-9aa9-b828ceaca4f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.362762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a3e0e-d7a0-4309-9aa9-b828ceaca4f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:32.363072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a3e0e-d7a0-4309-9aa9-b828ceaca4f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.364543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a3e0e-d7a0-4309-9aa9-b828ceaca4f4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.387268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:34.702851 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eec39e-363e-45d8-bce5-928f82339a6a None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.703432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eec39e-363e-45d8-bce5-928f82339a6a None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.703432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eec39e-363e-45d8-bce5-928f82339a6a None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.704752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:34.710251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfaa16-0376-46f1-8e91-89681d36bd2a None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.710706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfaa16-0376-46f1-8e91-89681d36bd2a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.710800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfaa16-0376-46f1-8e91-89681d36bd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.723188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac656-c4e5-4c46-bfd2-dad400c5e21f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.723720 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac656-c4e5-4c46-bfd2-dad400c5e21f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.725132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac656-c4e5-4c46-bfd2-dad400c5e21f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.726898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 13/23] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:34.733836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d39e37-9ee1-4fc3-a0a1-164d84b86262 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.734339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d39e37-9ee1-4fc3-a0a1-164d84b86262 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.734775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d39e37-9ee1-4fc3-a0a1-164d84b86262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.743816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-0acfaa16-0376-46f1-8e91-89681d36bd2a None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:34.746259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-0acfaa16-0376-46f1-8e91-89681d36bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:34.772570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-66d39e37-9ee1-4fc3-a0a1-164d84b86262 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:34.774079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-66d39e37-9ee1-4fc3-a0a1-164d84b86262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:34.870611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 14/24] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:34.909384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 11/25] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:35.005205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc06a5-7bba-4060-8889-2694e025056f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.005587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc06a5-7bba-4060-8889-2694e025056f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.005962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc06a5-7bba-4060-8889-2694e025056f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.007837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 15/26] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:35.012958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42b8b-a14e-4d85-b1f7-1c0ecdd0fdd8 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.013432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42b8b-a14e-4d85-b1f7-1c0ecdd0fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.013860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42b8b-a14e-4d85-b1f7-1c0ecdd0fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.040132 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-1fd42b8b-a14e-4d85-b1f7-1c0ecdd0fdd8 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:35.042945 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-1fd42b8b-a14e-4d85-b1f7-1c0ecdd0fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:35.101876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.137953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 12/27] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:35.148121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161707-8fd0-411c-8ed9-b7c5974a4b7e None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.148678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161707-8fd0-411c-8ed9-b7c5974a4b7e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.149163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161707-8fd0-411c-8ed9-b7c5974a4b7e None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.151689 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 16/28] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:35.156580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcc49-168b-445c-bfe9-768a4dccb671 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.156871 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcc49-168b-445c-bfe9-768a4dccb671 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.157157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcc49-168b-445c-bfe9-768a4dccb671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.178931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-9e8bcc49-168b-445c-bfe9-768a4dccb671 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:35.180147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-9e8bcc49-168b-445c-bfe9-768a4dccb671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:35.267585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161707-8fd0-411c-8ed9-b7c5974a4b7e None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.278539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 13/29] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:35.402832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.440747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161707-8fd0-411c-8ed9-b7c5974a4b7e None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.485183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240298-819d-49f0-8377-656317b1674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.485826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240298-819d-49f0-8377-656317b1674e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.486109 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240298-819d-49f0-8377-656317b1674e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.486386 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240298-819d-49f0-8377-656317b1674e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.501297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc240298-819d-49f0-8377-656317b1674e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-bc240298-819d-49f0-8377-656317b1674e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:35.506223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:35.507167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:35.508048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:35.511758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 17/30] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:35.518114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bcc49-168b-445c-bfe9-768a4dccb671 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.529767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240298-819d-49f0-8377-656317b1674e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.702209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bcc49-168b-445c-bfe9-768a4dccb671 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.714813 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.726417 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240298-819d-49f0-8377-656317b1674e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.764748 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.765480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.765761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.766031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.768435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.773728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.774363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.774639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.774970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:35.780480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.780480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.780670 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.780670 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.794056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 14/31] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:35.795715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:35.796572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:35.797392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:35.797392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:35.797392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:35.797392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 18/32] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:35.797992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.799574 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.911210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656466db-e96f-4f6c-9d1e-d024e088a2ae None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.943481 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b684da0-875b-4dbf-9c64-bfcb1f9398d5 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.952913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.953544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.953827 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.954105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.954990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.956674 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.983214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.983835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.984124 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.984379 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.985051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.986451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.171929 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 19/33] 10.222.0.58 () {60 vars in 1131 bytes} [Sun Aug 28 00:45:35 2022] POST /identity/v3/roles => generated 219 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:36.173476 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.196745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 15/34] 10.222.0.58 () {60 vars in 1131 bytes} [Sun Aug 28 00:45:35 2022] POST /identity/v3/roles => generated 225 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:36.198827 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.246243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.254432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.360691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280ff53-ec88-47a3-8ba0-3b5eca596e7c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.366972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c270f13-1581-47fc-ba87-ea929317ae5a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.412785 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.413712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.413989 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.414669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:36.414980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.416055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e147a2-86be-48e2-bda4-01fde3bbe5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.417281 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e147a2-86be-48e2-bda4-01fde3bbe5fc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.419924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e147a2-86be-48e2-bda4-01fde3bbe5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.420125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.420265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e147a2-86be-48e2-bda4-01fde3bbe5fc None admin] PATH_INFO: `/v3/users/00caaefe5f7440c9962342f8ae00dd35` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.422091 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e147a2-86be-48e2-bda4-01fde3bbe5fc None admin] RBAC: Authorizing `identity:get_user(user_id=00caaefe5f7440c9962342f8ae00dd35)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.422209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e147a2-86be-48e2-bda4-01fde3bbe5fc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.423917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 20/35] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:36 2022] GET /identity/v3/users/00caaefe5f7440c9962342f8ae00dd35 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:36.425300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89842ce6-1e15-411b-b583-73bb2b130e5c None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.425589 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89842ce6-1e15-411b-b583-73bb2b130e5c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.425865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89842ce6-1e15-411b-b583-73bb2b130e5c None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.427469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 21/36] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:36.429877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89842ce6-1e15-411b-b583-73bb2b130e5c None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.438174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 16/37] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:36.444013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.573441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.583772 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89842ce6-1e15-411b-b583-73bb2b130e5c None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.592582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d651e-d334-4747-80e0-b6a9166c9d0a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.601235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.630476 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67438f-ccee-4cc1-9ad8-5541b22631b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.651329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67438f-ccee-4cc1-9ad8-5541b22631b5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.651329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67438f-ccee-4cc1-9ad8-5541b22631b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.651329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67438f-ccee-4cc1-9ad8-5541b22631b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.651329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67438f-ccee-4cc1-9ad8-5541b22631b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.651329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67438f-ccee-4cc1-9ad8-5541b22631b5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.651329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 22/38] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:36.651957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637bdc5-aa5b-4acf-9986-17b0a6c41cc8 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.651957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637bdc5-aa5b-4acf-9986-17b0a6c41cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.651957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637bdc5-aa5b-4acf-9986-17b0a6c41cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.652138 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55285d-8097-4d53-b059-06df587f9ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.652138 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55285d-8097-4d53-b059-06df587f9ac0 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.652138 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55285d-8097-4d53-b059-06df587f9ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.652138 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55285d-8097-4d53-b059-06df587f9ac0 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.652393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55285d-8097-4d53-b059-06df587f9ac0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.652393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55285d-8097-4d53-b059-06df587f9ac0 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.665829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-6637bdc5-aa5b-4acf-9986-17b0a6c41cc8 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:36.667298 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6637bdc5-aa5b-4acf-9986-17b0a6c41cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:36.744228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 23/39] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:36.745686 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637bdc5-aa5b-4acf-9986-17b0a6c41cc8 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.766506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 17/40] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:36 2022] POST /identity/v3/projects => generated 301 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:36.767733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463b533-72e3-4ac8-96ec-0fbe21dac37b None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.768076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463b533-72e3-4ac8-96ec-0fbe21dac37b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.768579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463b533-72e3-4ac8-96ec-0fbe21dac37b None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.769888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 18/41] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:36.783019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3528b4-31f5-423b-906c-a8fd16e01924 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.783019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3528b4-31f5-423b-906c-a8fd16e01924 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.783019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3528b4-31f5-423b-906c-a8fd16e01924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.804903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-6c3528b4-31f5-423b-906c-a8fd16e01924 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:36.807421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6c3528b4-31f5-423b-906c-a8fd16e01924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:36.905626 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637bdc5-aa5b-4acf-9986-17b0a6c41cc8 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.917884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 19/42] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:36.924997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.950367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.951049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.951363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.951705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] PATH_INFO: `/v3/domains/default/users/00caaefe5f7440c9962342f8ae00dd35/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.954426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=00caaefe5f7440c9962342f8ae00dd35, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.955669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:37.021892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3528b4-31f5-423b-906c-a8fd16e01924 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:37.049382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 24/43] 10.222.0.58 () {58 vars in 1361 bytes} [Sun Aug 28 00:45:36 2022] PUT /identity/v3/domains/default/users/00caaefe5f7440c9962342f8ae00dd35/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:37.128232 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:37.165256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3528b4-31f5-423b-906c-a8fd16e01924 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:37.204553 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:37.208761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:37.209392 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.209675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.209936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.210610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:37.212068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:37.285120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 20/44] 10.222.0.58 () {60 vars in 1131 bytes} [Sun Aug 28 00:45:37 2022] POST /identity/v3/roles => generated 223 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:37.336099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e772f-49e7-49aa-b435-aa061ed71ac4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:37.385787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b8ba-02fc-4a7c-a62a-a91606646895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:37.386831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b8ba-02fc-4a7c-a62a-a91606646895 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.387136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b8ba-02fc-4a7c-a62a-a91606646895 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.387422 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b8ba-02fc-4a7c-a62a-a91606646895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.388736 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b8ba-02fc-4a7c-a62a-a91606646895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:37.390317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b8ba-02fc-4a7c-a62a-a91606646895 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:37.392377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 25/45] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:37.398306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:37.527136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666255a5-d442-43ec-9e5f-cfae4be1ad64 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:37.562037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:37.569455 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baea2dc-7e18-4777-a01f-999a2a504522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:37.570076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea2dc-7e18-4777-a01f-999a2a504522 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.570355 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea2dc-7e18-4777-a01f-999a2a504522 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.571150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea2dc-7e18-4777-a01f-999a2a504522 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.571834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baea2dc-7e18-4777-a01f-999a2a504522 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:37.573582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baea2dc-7e18-4777-a01f-999a2a504522 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:37.696801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 21/46] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:37 2022] POST /identity/v3/projects => generated 312 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:38.981272 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809abe-919e-4005-9925-c9169985a8c3 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.981771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809abe-919e-4005-9925-c9169985a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.981771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809abe-919e-4005-9925-c9169985a8c3 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.983079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 26/47] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:38.988701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065d7e9-4596-4fce-a5b2-f0277693a3a3 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.989220 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065d7e9-4596-4fce-a5b2-f0277693a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.989356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065d7e9-4596-4fce-a5b2-f0277693a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.008477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a065d7e9-4596-4fce-a5b2-f0277693a3a3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:39.009678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a065d7e9-4596-4fce-a5b2-f0277693a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:39.078921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 22/48] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:39.350621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809abe-919e-4005-9925-c9169985a8c3 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.505008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.567236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809abe-919e-4005-9925-c9169985a8c3 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.602637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.603230 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.603520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.604334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.614931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:39.617475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7e88-6edc-44dc-b62a-36c07676aed5 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.617757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7e88-6edc-44dc-b62a-36c07676aed5 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.618031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7e88-6edc-44dc-b62a-36c07676aed5 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.620232 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 23/49] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:39.620926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:39.621759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:39.622540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 27/50] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:39.625144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc32912-b412-405f-9cf2-90e5a9ba638d None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.625426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc32912-b412-405f-9cf2-90e5a9ba638d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.625700 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc32912-b412-405f-9cf2-90e5a9ba638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.627750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.643451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-7bc32912-b412-405f-9cf2-90e5a9ba638d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:39.644651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-7bc32912-b412-405f-9cf2-90e5a9ba638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:39.715777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 24/51] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:39.728373 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.732013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1896d-483a-438f-894e-5294919b1d69 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.766643 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.767299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.767597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.767858 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.768526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:39.768832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.770214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.779433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 28/52] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:39.784964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc32912-b412-405f-9cf2-90e5a9ba638d None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.943886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.999028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.002655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc32912-b412-405f-9cf2-90e5a9ba638d None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.039417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.040064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.040347 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.040629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] PATH_INFO: `/v3/users/00caaefe5f7440c9962342f8ae00dd35` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.042876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] RBAC: Authorizing `identity:get_user(user_id=00caaefe5f7440c9962342f8ae00dd35)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.044387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.046020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 25/53] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/users/00caaefe5f7440c9962342f8ae00dd35 => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:40.051785 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.105343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9102c0-8fa1-4bcb-893d-13ad11c03a22 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.138316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.138947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.139280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.139610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.140717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.142200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.143811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 29/54] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:40.149247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.155123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b536b-99ac-4530-a712-6d707714a011 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.165771 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.180676 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.189762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.190426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.190710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.191199 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.192361 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.194423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.196920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 26/55] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:40.202885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.255544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df586885-e3dc-4bef-b6fa-3abfe4387668 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.289719 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac714f-dddf-4bcd-846c-20f86d0a1c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.290334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac714f-dddf-4bcd-846c-20f86d0a1c53 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.290615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac714f-dddf-4bcd-846c-20f86d0a1c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.290888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac714f-dddf-4bcd-846c-20f86d0a1c53 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.292447 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac714f-dddf-4bcd-846c-20f86d0a1c53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.293904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac714f-dddf-4bcd-846c-20f86d0a1c53 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.304724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6fcd5-9860-4e63-8306-e5194306b817 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.337550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666226f-b2f9-4d03-831b-6113d61b5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.338859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666226f-b2f9-4d03-831b-6113d61b5b03 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.339348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666226f-b2f9-4d03-831b-6113d61b5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.339659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666226f-b2f9-4d03-831b-6113d61b5b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.340396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666226f-b2f9-4d03-831b-6113d61b5b03 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.domain.id=default, user.id=00caaefe5f7440c9962342f8ae00dd35) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:40.340706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666226f-b2f9-4d03-831b-6113d61b5b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.342152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666226f-b2f9-4d03-831b-6113d61b5b03 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.351402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 27/56] 10.222.0.58 () {56 vars in 1322 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/role_assignments?user.id=00caaefe5f7440c9962342f8ae00dd35&scope.domain.id=default&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:40.359723 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 30/57] 10.222.0.58 () {60 vars in 1140 bytes} [Sun Aug 28 00:45:40 2022] POST /identity/v3/projects => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:42.318305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cacca-2efa-4958-a0f8-ac1b9cedc127 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.318818 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cacca-2efa-4958-a0f8-ac1b9cedc127 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.318901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cacca-2efa-4958-a0f8-ac1b9cedc127 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.320238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 28/58] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:42.325466 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d870a-11d7-4572-b010-399e9130edb7 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.325845 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d870a-11d7-4572-b010-399e9130edb7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.326023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d870a-11d7-4572-b010-399e9130edb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.345553 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-754d870a-11d7-4572-b010-399e9130edb7 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:42.346728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-754d870a-11d7-4572-b010-399e9130edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:42.412248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 31/59] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:42.685775 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cacca-2efa-4958-a0f8-ac1b9cedc127 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:42.732010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:42.790319 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cacca-2efa-4958-a0f8-ac1b9cedc127 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:42.824514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79a71-af55-4baf-9eef-7b234d3d2c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:42.825161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79a71-af55-4baf-9eef-7b234d3d2c80 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.825445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79a71-af55-4baf-9eef-7b234d3d2c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.825729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79a71-af55-4baf-9eef-7b234d3d2c80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.826862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da79a71-af55-4baf-9eef-7b234d3d2c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:42.828362 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da79a71-af55-4baf-9eef-7b234d3d2c80 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:42.829945 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 29/60] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:42.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d870a-11d7-4572-b010-399e9130edb7 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:42.850585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:42.934296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d870a-11d7-4572-b010-399e9130edb7 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:42.968787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef7e30-6d22-4e0d-a3d8-ea9d7ec4e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:42.969649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7e30-6d22-4e0d-a3d8-ea9d7ec4e134 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.969924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7e30-6d22-4e0d-a3d8-ea9d7ec4e134 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.970193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7e30-6d22-4e0d-a3d8-ea9d7ec4e134 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.970845 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef7e30-6d22-4e0d-a3d8-ea9d7ec4e134 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:42.972329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef7e30-6d22-4e0d-a3d8-ea9d7ec4e134 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:43.061210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 32/61] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:42 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:46.111364 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b077-4694-4f73-be06-5a7aa5eb32a6 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.111894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b077-4694-4f73-be06-5a7aa5eb32a6 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.111894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b077-4694-4f73-be06-5a7aa5eb32a6 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.113273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 30/62] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:46.128428 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cac8-9be4-413f-a248-fc0de504974f None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.128944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cac8-9be4-413f-a248-fc0de504974f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.129019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2cac8-9be4-413f-a248-fc0de504974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.152606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-6cc2cac8-9be4-413f-a248-fc0de504974f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:46.153836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6cc2cac8-9be4-413f-a248-fc0de504974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:46.232020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.240868 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 33/63] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:46.253674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfd06e-6f02-406a-99b5-6ca78fb817f5 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.254289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfd06e-6f02-406a-99b5-6ca78fb817f5 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.254767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfd06e-6f02-406a-99b5-6ca78fb817f5 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.256612 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 31/64] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:46.262740 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb946e-2b96-47b3-8497-6edd96806f79 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.263328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb946e-2b96-47b3-8497-6edd96806f79 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.263824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb946e-2b96-47b3-8497-6edd96806f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.295621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-25cb946e-2b96-47b3-8497-6edd96806f79 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:46.298611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-25cb946e-2b96-47b3-8497-6edd96806f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:46.398909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 34/65] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:46.472558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478360-16c0-4182-8a92-827023a08133 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.473206 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478360-16c0-4182-8a92-827023a08133 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.473687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478360-16c0-4182-8a92-827023a08133 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.475542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 32/66] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:46.481528 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd0264-a234-432b-b061-f94b3b36c21f None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.481820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd0264-a234-432b-b061-f94b3b36c21f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.482107 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd0264-a234-432b-b061-f94b3b36c21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.509148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-47bd0264-a234-432b-b061-f94b3b36c21f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:46.510901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-47bd0264-a234-432b-b061-f94b3b36c21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:46.608563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 35/67] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:46.617802 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62478360-16c0-4182-8a92-827023a08133 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.636931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0702b-e781-4883-8f33-09df73324ee3 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.637597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0702b-e781-4883-8f33-09df73324ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.638071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0702b-e781-4883-8f33-09df73324ee3 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.639669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 36/68] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:46.644943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859363-0e4a-4fc7-b5ab-bfe495f6b747 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.645396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859363-0e4a-4fc7-b5ab-bfe495f6b747 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.645833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859363-0e4a-4fc7-b5ab-bfe495f6b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.667226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0a859363-0e4a-4fc7-b5ab-bfe495f6b747 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:46.668876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0a859363-0e4a-4fc7-b5ab-bfe495f6b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:46.756807 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.773727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 37/69] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:46.779027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859363-0e4a-4fc7-b5ab-bfe495f6b747 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.796997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62478360-16c0-4182-8a92-827023a08133 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.817028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.858942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26c684-9946-41c3-9f13-b62d5bc98876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.859608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26c684-9946-41c3-9f13-b62d5bc98876 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.859886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26c684-9946-41c3-9f13-b62d5bc98876 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.860161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26c684-9946-41c3-9f13-b62d5bc98876 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.877609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26c684-9946-41c3-9f13-b62d5bc98876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-ed26c684-9946-41c3-9f13-b62d5bc98876 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:46.884402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:46.885993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:46.886965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:46.889014 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 33/70] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:46.890405 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdbf3-a837-470c-91d7-ed3d54016bb6 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.890844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdbf3-a837-470c-91d7-ed3d54016bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.891389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cdbf3-a837-470c-91d7-ed3d54016bb6 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.892870 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 34/71] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:46.897904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdbf3-a837-470c-91d7-ed3d54016bb6 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.916065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859363-0e4a-4fc7-b5ab-bfe495f6b747 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.959531 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9394135-d2dd-4de1-a1df-cfd83dc509ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.960909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394135-d2dd-4de1-a1df-cfd83dc509ca None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.961346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394135-d2dd-4de1-a1df-cfd83dc509ca None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.961754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394135-d2dd-4de1-a1df-cfd83dc509ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.973648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9394135-d2dd-4de1-a1df-cfd83dc509ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-d9394135-d2dd-4de1-a1df-cfd83dc509ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:46.978507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:46.979390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:46.981061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 38/72] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:46.981721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b3bf-28f3-4aff-8814-b3f439369e39 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.981969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b3bf-28f3-4aff-8814-b3f439369e39 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.982163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b3bf-28f3-4aff-8814-b3f439369e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.000053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0df5b3bf-28f3-4aff-8814-b3f439369e39 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:47.001242 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0df5b3bf-28f3-4aff-8814-b3f439369e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:47.008242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cdbf3-a837-470c-91d7-ed3d54016bb6 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.042063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.042674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.042950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.043253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.043927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.044244 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.045641 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.048408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.054439 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 35/73] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.059732 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.077210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 39/74] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:47.078094 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5b3bf-28f3-4aff-8814-b3f439369e39 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.099978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.177434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbbc71-5e0f-4f49-9e19-1463f4e4942d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.196725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5b3bf-28f3-4aff-8814-b3f439369e39 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.216726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.217290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.217567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.217834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.229206 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:47.234083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:47.234970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:47.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 36/75] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:47.237106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.241751 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.242383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.242671 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.242958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.243666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.244010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.245792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.260355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 40/76] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.260355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.307634 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.336028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.346743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d99b-db9a-4c19-8a63-de687d196a08 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.372366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ef099-401a-4996-a6c6-2c4e315f6ca0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.381518 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.382150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.382428 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.382702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.397749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.399393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.401076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 37/77] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.401847 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.406537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.407191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.407468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.407738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.418600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:47.423463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:47.424348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:47.425159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 41/78] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:47.425786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.507957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac7924-051d-4a92-98d3-2f5b6d0d65e1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.521054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.524238 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef80e6-06c6-4ac5-98e1-02c079681930 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.543376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.543985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.544262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.544534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.545254 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.545558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.546955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.556309 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 38/79] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.557280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.564205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.564846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.565126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.565407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] PATH_INFO: `/v3/users/00caaefe5f7440c9962342f8ae00dd35` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.566538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] RBAC: Authorizing `identity:get_user(user_id=00caaefe5f7440c9962342f8ae00dd35)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.568038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.569607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 42/80] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/users/00caaefe5f7440c9962342f8ae00dd35 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.570370 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.571814 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.659618 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15fb94-3319-40ba-96a4-9191d37a0aa4 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.677451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9884f7-d3cb-47a8-97f0-7efe9ab95d1e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.693762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.694399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.694678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.694960 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.696110 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.697574 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.699382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 39/81] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.700039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.716716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.717335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.717618 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.717893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.752868 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.781460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.786197 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.787701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.800342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ddca-8325-4c96-8c18-a69d4f7150f1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.835480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.836092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.836377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.836653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.837321 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.837636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.839559 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.847769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 40/82] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.848646 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.893127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 43/83] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:47.894038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.948736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376b1fc-bab7-4be0-8ad1-2b25d31799c8 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.962191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.983619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.984259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.984540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.984810 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.985970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.987456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.989210 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 41/84] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.989791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.001671 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b277a5-1708-4640-a99a-04a994e9c240 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.002258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.036226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.036754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.037034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.037294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.092062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4630ca-f5a0-4e76-9845-d9fdd70accf6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.105118 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.106611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.126031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.126307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.126578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.127253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.128698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.170837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.203901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 44/85] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:48.204729 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.232025 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 42/86] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:47 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:48.232960 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.308516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.316455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d526f73-b1a7-4cb5-930b-d741c2ae9a96 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.350432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fecbc-620f-4e9f-a9cb-e1cade488603 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.359698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.360356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.360636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.360912 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.362154 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.363698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.365339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 45/87] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:48.365339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.396280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.397652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.397964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.398221 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.399463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.401496 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.403233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 43/88] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:48.404021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.406100 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.493487 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c2bc8-cf8a-4fcd-a9ee-77cc27f05efc None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.532951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261cd17-0f00-49c6-8ce2-e3eea9c69f4b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.538573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.539229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.539520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.539796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.571856 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.572480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.572756 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.573033 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.574188 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.576578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 44/89] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:48.578069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.580809 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.629025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.631169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.676810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.709919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccd2f2-6120-49e1-bb02-39723b371740 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.749565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.750417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.750773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.751186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.760132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 46/90] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:48.761111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.841039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.841556 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.843984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.881324 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56018449-167f-4e95-bfbe-3b807695e9c3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.921095 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.921746 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.922037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.922572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.923360 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=b16bbf73d702424c9a4d703e49d68880) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:48.923974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.926126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.929839 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.934393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 47/91] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/role_assignments?user.id=b16bbf73d702424c9a4d703e49d68880&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:48.943145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.028425 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 45/92] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:49.029336 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.074510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3afe-1695-4334-b8c1-f5448e4f45ab None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.120597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.121517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.121876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.122229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.123069 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=00caaefe5f7440c9962342f8ae00dd35) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:49.123484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.125056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.132137 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 48/93] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/role_assignments?user.id=00caaefe5f7440c9962342f8ae00dd35&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:49.133271 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.267171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:49.280633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9a7f-64d6-48c8-91d9-46757fa78f8d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.284987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:49.341699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15981e-2d1a-4c98-8b56-96d201148f60 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.352594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.353294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.354177 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.354420 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] PATH_INFO: `/v3/projects/979a5f18b88a4fc48a99e4001eadaf80` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.357501 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] RBAC: Authorizing `identity:get_project(project_id=979a5f18b88a4fc48a99e4001eadaf80)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.359037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.365880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 46/94] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/projects/979a5f18b88a4fc48a99e4001eadaf80 => generated 312 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:49.368983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.445595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.446169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.446451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.446727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.449507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.451064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.456199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 49/95] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:49.459247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.572426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5050-324c-442b-bf66-643b16f324d5 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.651804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b1eed-e139-4d81-8f91-efa245569e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.652436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1eed-e139-4d81-8f91-efa245569e57 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.652723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1eed-e139-4d81-8f91-efa245569e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.652997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1eed-e139-4d81-8f91-efa245569e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.653748 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b1eed-e139-4d81-8f91-efa245569e57 None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=979a5f18b88a4fc48a99e4001eadaf80, user.id=b16bbf73d702424c9a4d703e49d68880) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:49.654056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b1eed-e139-4d81-8f91-efa245569e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.655552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b1eed-e139-4d81-8f91-efa245569e57 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.670536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 47/96] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/role_assignments?user.id=b16bbf73d702424c9a4d703e49d68880&scope.project.id=979a5f18b88a4fc48a99e4001eadaf80&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:49.720228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8173413-72cc-41f8-a1ba-1583e79a62af None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.776889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:49.782980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9ad9-b6b0-436f-a014-171bf763d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.783765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9ad9-b6b0-436f-a014-171bf763d530 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.784050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9ad9-b6b0-436f-a014-171bf763d530 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.784327 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9ad9-b6b0-436f-a014-171bf763d530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.785089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9ad9-b6b0-436f-a014-171bf763d530 None admin] RBAC: Adding query filter params (role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=b16bbf73d702424c9a4d703e49d68880) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:49.785407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9ad9-b6b0-436f-a014-171bf763d530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.786939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf9ad9-b6b0-436f-a014-171bf763d530 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.793579 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 50/97] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/role_assignments?user.id=b16bbf73d702424c9a4d703e49d68880&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:50.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69787-a1d9-439c-ac7d-d7d7292f6ea2 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69787-a1d9-439c-ac7d-d7d7292f6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69787-a1d9-439c-ac7d-d7d7292f6ea2 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 48/98] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:50.709097 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc44b5c-55ab-4310-a882-445a184694e1 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.709527 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc44b5c-55ab-4310-a882-445a184694e1 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.709719 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc44b5c-55ab-4310-a882-445a184694e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.740124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-fbc44b5c-55ab-4310-a882-445a184694e1 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:50.741416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-fbc44b5c-55ab-4310-a882-445a184694e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:50.816558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307165-5f5e-41aa-af38-c6f61ca6f015 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.816558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307165-5f5e-41aa-af38-c6f61ca6f015 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.816558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307165-5f5e-41aa-af38-c6f61ca6f015 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.817249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 49/99] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:50.824835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2dc2-4929-467d-9f9a-5344fccae6ce None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.825389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2dc2-4929-467d-9f9a-5344fccae6ce None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.825853 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2dc2-4929-467d-9f9a-5344fccae6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.844218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 51/100] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:50.848554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-1aeb2dc2-4929-467d-9f9a-5344fccae6ce None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:50.849958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-1aeb2dc2-4929-467d-9f9a-5344fccae6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:50.891683 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:50.948704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 50/101] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:51.363590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc44b5c-55ab-4310-a882-445a184694e1 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.492887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc44b5c-55ab-4310-a882-445a184694e1 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.521233 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:51.531998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.532497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.532780 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.533058 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.545021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:51.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:51.553323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:51.554175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 52/102] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:51.560630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2dc2-4929-467d-9f9a-5344fccae6ce None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.584081 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.709263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8cd31-4e63-408f-87b0-cc9ea3d7b70d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.746115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2dc2-4929-467d-9f9a-5344fccae6ce None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.772258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.772927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.773212 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.773490 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.774870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:51.776849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:51.778501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 53/103] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:51.792196 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.797685 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.798664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.799195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.799687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.800579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:51.801083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:51.802767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:51.813868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 51/104] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:51.832802 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.863829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:51.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:51.919210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e612-eb92-42ec-8107-c3ae55ebf0a7 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.951999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b310c-42cc-4600-8f0e-36cc05f0d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.952615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b310c-42cc-4600-8f0e-36cc05f0d21f None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.952894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b310c-42cc-4600-8f0e-36cc05f0d21f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.953170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b310c-42cc-4600-8f0e-36cc05f0d21f None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.953897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b310c-42cc-4600-8f0e-36cc05f0d21f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:51.955513 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b310c-42cc-4600-8f0e-36cc05f0d21f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.036697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fae1-59f3-4881-8ef4-8f5a7129ad2f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.082275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.083305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.083766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.084298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] PATH_INFO: `/v3/users/97668602fac54cc3aa0f465b04820434` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.087439 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 54/105] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:51 2022] POST /identity/v3/projects => generated 302 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:52.089808 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4a31-2f76-4475-9e03-5236180d14e5 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.089808 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4a31-2f76-4475-9e03-5236180d14e5 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.089991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4a31-2f76-4475-9e03-5236180d14e5 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.091287 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 55/106] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:52.112366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] RBAC: Authorizing `identity:get_user(user_id=97668602fac54cc3aa0f465b04820434)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.114217 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.116391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 52/107] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/users/97668602fac54cc3aa0f465b04820434 => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:52.116915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59785c-c3c5-46d8-8b74-f73a430810a3 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.117203 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59785c-c3c5-46d8-8b74-f73a430810a3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.117485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59785c-c3c5-46d8-8b74-f73a430810a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.123888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.163940 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-1d59785c-c3c5-46d8-8b74-f73a430810a3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:52.163940 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-1d59785c-c3c5-46d8-8b74-f73a430810a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:52.257179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.280996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240026-30d1-48a7-b6f5-12675cc83723 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.325941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f3c1a-4a95-417f-8063-23f74efd66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.326885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3c1a-4a95-417f-8063-23f74efd66ce None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.327382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3c1a-4a95-417f-8063-23f74efd66ce None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.327869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3c1a-4a95-417f-8063-23f74efd66ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.376541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 56/108] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:52.398542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4191e5-baa4-434d-bff7-9b776c67434f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.398827 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4191e5-baa4-434d-bff7-9b776c67434f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.399123 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4191e5-baa4-434d-bff7-9b776c67434f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.402982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 57/109] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:52.409683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ee039-7385-4c7b-91e8-370a12706236 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.410411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ee039-7385-4c7b-91e8-370a12706236 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.410568 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ee039-7385-4c7b-91e8-370a12706236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.425889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f3c1a-4a95-417f-8063-23f74efd66ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.432598 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f3c1a-4a95-417f-8063-23f74efd66ce None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.449696 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-5f6ee039-7385-4c7b-91e8-370a12706236 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:52.451245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5f6ee039-7385-4c7b-91e8-370a12706236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:52.531488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.601083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.608075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 58/110] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:52.626252 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 53/111] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:52.631776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ee039-7385-4c7b-91e8-370a12706236 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.639947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f0e8-dc3c-49d6-a5e2-a5d169b5b8ed None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.640554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f0e8-dc3c-49d6-a5e2-a5d169b5b8ed None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.641034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f0e8-dc3c-49d6-a5e2-a5d169b5b8ed None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.642622 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 54/112] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:52.648287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3cd1-0d1d-4836-8b58-fc060e3a2e70 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.648929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3cd1-0d1d-4836-8b58-fc060e3a2e70 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.649417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3cd1-0d1d-4836-8b58-fc060e3a2e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.684213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-7aac3cd1-0d1d-4836-8b58-fc060e3a2e70 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:52.685450 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-7aac3cd1-0d1d-4836-8b58-fc060e3a2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:52.816186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 55/113] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:52.817341 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3cd1-0d1d-4836-8b58-fc060e3a2e70 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.828170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ee039-7385-4c7b-91e8-370a12706236 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.906317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7f18d-c3cb-443a-b72c-8c631d0f8ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.906974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7f18d-c3cb-443a-b72c-8c631d0f8ffa None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.907286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7f18d-c3cb-443a-b72c-8c631d0f8ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.907563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7f18d-c3cb-443a-b72c-8c631d0f8ffa None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.908733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7f18d-c3cb-443a-b72c-8c631d0f8ffa None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.910195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7f18d-c3cb-443a-b72c-8c631d0f8ffa None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.911893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 59/114] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:52.913047 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066062e4-ee60-4346-8101-fee985b29272 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.913330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066062e4-ee60-4346-8101-fee985b29272 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.913606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066062e4-ee60-4346-8101-fee985b29272 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.914833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 60/115] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:52.920145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066062e4-ee60-4346-8101-fee985b29272 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.960680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.033788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3cd1-0d1d-4836-8b58-fc060e3a2e70 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.050756 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.052653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066062e4-ee60-4346-8101-fee985b29272 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.075168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b64cc9-e728-44af-9f34-b72c2cf38eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.075743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64cc9-e728-44af-9f34-b72c2cf38eba None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64cc9-e728-44af-9f34-b72c2cf38eba None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.077277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b64cc9-e728-44af-9f34-b72c2cf38eba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.090540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b64cc9-e728-44af-9f34-b72c2cf38eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:53.091373 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.092232 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.092708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.093189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.094381 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] RBAC: Adding query filter params (role.id=9eb4e632f5fd40cfa2d008c4408aa72e, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=97668602fac54cc3aa0f465b04820434) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:53.094902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f9b64cc9-e728-44af-9f34-b72c2cf38eba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:53.095981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.096901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:53.097693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:53.099502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.102169 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 56/116] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:53.104881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969909-6933-4b82-a749-f49da588c638 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.105179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969909-6933-4b82-a749-f49da588c638 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.105489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969909-6933-4b82-a749-f49da588c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.107582 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 61/117] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/role_assignments?user.id=97668602fac54cc3aa0f465b04820434&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=9eb4e632f5fd40cfa2d008c4408aa72e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.108788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.141069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-be969909-6933-4b82-a749-f49da588c638 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:53.142808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-be969909-6933-4b82-a749-f49da588c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:53.248647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.253357 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee358ad-e45a-40d7-87f3-f398bbe95d67 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.260906 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 57/118] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:53.262090 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be969909-6933-4b82-a749-f49da588c638 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.301797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.302822 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.303119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.303485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.315623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:53.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.329517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 62/119] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:53.330468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.408670 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be969909-6933-4b82-a749-f49da588c638 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.411499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.463831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d620c6-036d-4194-ae22-65d8cc433c19 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.488891 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.489489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.489768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.490042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.490729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:53.491032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.492647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.505338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.506613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.509135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.509659 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.517975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 58/120] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.519375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.535657 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:53.550260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:53.551983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:53.556022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 63/121] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:53.560575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.584509 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.657186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160883a-40dc-4a4d-8aac-66fcdd4b7cca None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.694498 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630af08-115b-4f6d-8f78-b2abc7a6aa2f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.707936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.708583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.708786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.709067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.709752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:53.710060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.711503 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.722582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 59/122] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.727762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.738609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.739660 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.740219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.740714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.742250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.744600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.746745 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 64/123] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.747859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.761197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.848544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585300cc-daca-4d64-be51-c8146ae49bfd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.850263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.867678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b58934-e1a6-477d-9fdc-5aa33342478e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.890938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.892145 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.892602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.893026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.893852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:53.894302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.896183 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.910988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.910988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.910988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.910988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.911541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 60/124] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.912744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.922104 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:53.928222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.929170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:53.930045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 65/125] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:53.930691 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.024663 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.036484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ddd3d-8917-431b-b342-b524a9c1d3f2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.046304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae253a-c21b-430c-a907-9ed61770ffc5 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.090205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.090928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.091342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.091740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] PATH_INFO: `/v3/users/00caaefe5f7440c9962342f8ae00dd35` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.093060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] RBAC: Authorizing `identity:get_user(user_id=00caaefe5f7440c9962342f8ae00dd35)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.094849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.096934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 61/126] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/users/00caaefe5f7440c9962342f8ae00dd35 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.098011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.100322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.101563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.101994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.103432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.107842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.110296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.112396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 66/127] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.114027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.143532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.229656 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e5356-bd6a-418e-a4d2-167c7fc4ac1e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.254734 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae921b-8edb-4831-acad-3dddf439f779 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.276208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.276865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.277151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.278746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.280251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.282211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 62/128] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.282782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.313842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.314846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.315299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.315716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.316304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.316637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:54.316893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.318430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.330849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 67/129] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.331594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.431925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.432392 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568147-3c0e-4dca-a078-8a2a971d78fc None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.461872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53139681-c37c-4658-af10-12d5a80bcc6b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.473913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.474568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.475089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.475209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.476334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.477804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.479813 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 63/130] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.480789 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.503909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.504993 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.505482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.505960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/b16bbf73d702424c9a4d703e49d68880/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.508204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] RBAC: Authorizing `identity:create_grant(project_id=71ff6b9731cb4eae9ad324df59928ed5, user_id=b16bbf73d702424c9a4d703e49d68880, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.509995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.586501 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.589760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 68/131] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:54 2022] PUT /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/b16bbf73d702424c9a4d703e49d68880/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:54.590525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.596758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344767-f157-4319-8249-bf1ef572def0 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.641283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.642022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.642308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.642720 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.643875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.645440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.658245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 64/132] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.658245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.770683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55c8c2-91fe-4f82-8587-1bd0752c869b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.814898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415faa3-ce60-417d-ac94-373c32fbc342 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.815411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15627819-9510-4451-a5ea-0d71bb82609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.816061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627819-9510-4451-a5ea-0d71bb82609c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.816340 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627819-9510-4451-a5ea-0d71bb82609c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.816610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627819-9510-4451-a5ea-0d71bb82609c None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.817780 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15627819-9510-4451-a5ea-0d71bb82609c None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.819291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15627819-9510-4451-a5ea-0d71bb82609c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.820898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 69/133] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.822327 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076753-79fa-4294-ac90-855e867ac790 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.822760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076753-79fa-4294-ac90-855e867ac790 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.823043 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076753-79fa-4294-ac90-855e867ac790 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.824752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 70/134] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:54.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f076753-79fa-4294-ac90-855e867ac790 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.832307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.867092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.868675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.869195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.870603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/00caaefe5f7440c9962342f8ae00dd35/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.872840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] RBAC: Authorizing `identity:create_grant(project_id=71ff6b9731cb4eae9ad324df59928ed5, user_id=00caaefe5f7440c9962342f8ae00dd35, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.874438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f076753-79fa-4294-ac90-855e867ac790 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.963174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 65/135] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:54 2022] PUT /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/00caaefe5f7440c9962342f8ae00dd35/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:54.967552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.019811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:55.048527 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ad7f-a35f-4221-9089-598ba4572623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.049178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ad7f-a35f-4221-9089-598ba4572623 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.049461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ad7f-a35f-4221-9089-598ba4572623 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.049736 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ad7f-a35f-4221-9089-598ba4572623 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/b16bbf73d702424c9a4d703e49d68880/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.055753 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ad7f-a35f-4221-9089-598ba4572623 None admin] RBAC: Authorizing `identity:create_grant(project_id=71ff6b9731cb4eae9ad324df59928ed5, user_id=b16bbf73d702424c9a4d703e49d68880, role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.058053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ad7f-a35f-4221-9089-598ba4572623 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.129892 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 71/136] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:54 2022] PUT /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/b16bbf73d702424c9a4d703e49d68880/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:55.131381 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cacc75-2866-48e2-9b4b-a23ba7ee9a97 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.131669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cacc75-2866-48e2-9b4b-a23ba7ee9a97 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.131958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cacc75-2866-48e2-9b4b-a23ba7ee9a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.160585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdddec5-b3c7-45fd-88df-b070d24183ce None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.169358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-32cacc75-2866-48e2-9b4b-a23ba7ee9a97 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:55.170640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-32cacc75-2866-48e2-9b4b-a23ba7ee9a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:55.258451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.259139 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.260046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.260328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] PATH_INFO: `/v3/projects/979a5f18b88a4fc48a99e4001eadaf80` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.267609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] RBAC: Authorizing `identity:get_project(project_id=979a5f18b88a4fc48a99e4001eadaf80)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.272214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.274234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 66/137] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/projects/979a5f18b88a4fc48a99e4001eadaf80 => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:55.282238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.308943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:55.320962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:55.429990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cfe14-78bf-4729-9d17-d2d204911739 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.430619 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cfe14-78bf-4729-9d17-d2d204911739 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.431141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:55.431812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cfe14-78bf-4729-9d17-d2d204911739 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.434037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 73/139] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:55.442865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd228-2aea-45b1-b190-f71bac82a92d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.446147 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd228-2aea-45b1-b190-f71bac82a92d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.446147 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd228-2aea-45b1-b190-f71bac82a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.446319 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c192817-94f6-44cc-908b-f635f101f527 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.478673 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-f8bcd228-2aea-45b1-b190-f71bac82a92d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:55.480252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-f8bcd228-2aea-45b1-b190-f71bac82a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:55.517638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.518351 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.518641 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.518921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] PATH_INFO: `/v3/projects/979a5f18b88a4fc48a99e4001eadaf80/users/b16bbf73d702424c9a4d703e49d68880/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.523847 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] RBAC: Authorizing `identity:create_grant(project_id=979a5f18b88a4fc48a99e4001eadaf80, user_id=b16bbf73d702424c9a4d703e49d68880, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.525477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.602928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 74/140] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:55.635012 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 67/141] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:55 2022] PUT /identity/v3/projects/979a5f18b88a4fc48a99e4001eadaf80/users/b16bbf73d702424c9a4d703e49d68880/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:55.636795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd228-2aea-45b1-b190-f71bac82a92d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.767704 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd228-2aea-45b1-b190-f71bac82a92d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.815526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:55.830880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.831584 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.831867 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.832141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.833353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.834866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.836822 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 75/142] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:55.843216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.934339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.966885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1448877-e83d-4814-b6f6-fdfba607590c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.008535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.009191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.010183 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.010570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.011978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:56.013555 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:56.069431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36c2a-65ca-4dc2-aac0-ace4fbe3adf4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.111695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.112641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.112971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.113250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.121980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 68/143] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:55 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:56.126193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:56.131576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:56.133237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:45:56.134925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 76/144] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:56.141014 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:56.154966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:56.269339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03562f-f87e-45f5-bf6c-bc621c829f90 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.318827 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70331-0554-464c-b231-705d3592524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.319490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70331-0554-464c-b231-705d3592524c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.319773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70331-0554-464c-b231-705d3592524c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.320050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70331-0554-464c-b231-705d3592524c None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.320746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70331-0554-464c-b231-705d3592524c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:56.321051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70331-0554-464c-b231-705d3592524c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:56.322482 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70331-0554-464c-b231-705d3592524c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:56.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 69/145] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:56.337353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:56.421105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:56.493170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9df10-288a-4415-a735-3e823a5c31de None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.542093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.542781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.543063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.543374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] PATH_INFO: `/v3/users/97668602fac54cc3aa0f465b04820434` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.544577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] RBAC: Authorizing `identity:get_user(user_id=97668602fac54cc3aa0f465b04820434)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:56.546052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:56.547686 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 77/146] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:56 2022] GET /identity/v3/users/97668602fac54cc3aa0f465b04820434 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:56.553537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70331-0554-464c-b231-705d3592524c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:56.655827 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:56.701777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70331-0554-464c-b231-705d3592524c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.741967 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fceb6-3a80-4c6c-b60b-26c2124a7073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.742622 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fceb6-3a80-4c6c-b60b-26c2124a7073 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.742903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fceb6-3a80-4c6c-b60b-26c2124a7073 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.743201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fceb6-3a80-4c6c-b60b-26c2124a7073 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.745271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fceb6-3a80-4c6c-b60b-26c2124a7073 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:56.746754 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fceb6-3a80-4c6c-b60b-26c2124a7073 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:56.748532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 70/147] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:56 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:56.754373 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:56.881155 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cdeaf-01e3-4e4f-bec7-c9fd697639d9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.908998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:56.927577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94ac61-cdae-4f95-9d8a-a9061fc21e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.928247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ac61-cdae-4f95-9d8a-a9061fc21e50 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.928528 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ac61-cdae-4f95-9d8a-a9061fc21e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.928801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ac61-cdae-4f95-9d8a-a9061fc21e50 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/97668602fac54cc3aa0f465b04820434/roles/9eb4e632f5fd40cfa2d008c4408aa72e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.933096 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94ac61-cdae-4f95-9d8a-a9061fc21e50 None admin] RBAC: Authorizing `identity:create_grant(project_id=71ff6b9731cb4eae9ad324df59928ed5, user_id=97668602fac54cc3aa0f465b04820434, role_id=9eb4e632f5fd40cfa2d008c4408aa72e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:56.934613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94ac61-cdae-4f95-9d8a-a9061fc21e50 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:57.038234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 78/148] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:56 2022] PUT /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/users/97668602fac54cc3aa0f465b04820434/roles/9eb4e632f5fd40cfa2d008c4408aa72e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:57.736503 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7520-4340-40c1-9527-4ad75319ac92 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.737000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7520-4340-40c1-9527-4ad75319ac92 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.737071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7520-4340-40c1-9527-4ad75319ac92 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.738415 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 71/149] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:57.745082 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6341df4-c181-4367-8e76-2f9a54c9d9a3 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.745558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6341df4-c181-4367-8e76-2f9a54c9d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.745633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6341df4-c181-4367-8e76-2f9a54c9d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.766533 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e6341df4-c181-4367-8e76-2f9a54c9d9a3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:57.767860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e6341df4-c181-4367-8e76-2f9a54c9d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:57.847488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 79/150] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:58.038881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264895f0-99d2-4fe2-9d41-62e079631cb2 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.039270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264895f0-99d2-4fe2-9d41-62e079631cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.039520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264895f0-99d2-4fe2-9d41-62e079631cb2 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.041816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 72/151] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:58.047596 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6318-7c18-4e0c-af98-0b8fcf92846e None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.047882 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6318-7c18-4e0c-af98-0b8fcf92846e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.048160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6318-7c18-4e0c-af98-0b8fcf92846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.069510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-da1a6318-7c18-4e0c-af98-0b8fcf92846e None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:58.070711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-da1a6318-7c18-4e0c-af98-0b8fcf92846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:58.153992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 80/152] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:58.278730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264895f0-99d2-4fe2-9d41-62e079631cb2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.410676 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264895f0-99d2-4fe2-9d41-62e079631cb2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.424701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99014b-3789-4fa9-9a4f-4385905c752f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.424995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99014b-3789-4fa9-9a4f-4385905c752f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.425264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99014b-3789-4fa9-9a4f-4385905c752f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.426635 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 81/153] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:58.439230 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb3d2-bb7a-477e-bcc2-8cfad25926a6 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.439513 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb3d2-bb7a-477e-bcc2-8cfad25926a6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.439783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb3d2-bb7a-477e-bcc2-8cfad25926a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.470421 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-436bb3d2-bb7a-477e-bcc2-8cfad25926a6 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:58.472150 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-436bb3d2-bb7a-477e-bcc2-8cfad25926a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:58.483147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c64f3b-63e0-4d16-a81c-3cd46c5e7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.483803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c64f3b-63e0-4d16-a81c-3cd46c5e7616 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.484078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c64f3b-63e0-4d16-a81c-3cd46c5e7616 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.484350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c64f3b-63e0-4d16-a81c-3cd46c5e7616 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.490781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.500667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c64f3b-63e0-4d16-a81c-3cd46c5e7616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-d9c64f3b-63e0-4d16-a81c-3cd46c5e7616 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:58.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:58.506543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:58.507352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 73/154] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:58.507989 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505894-0fa9-4928-979a-eb612c8273c3 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.508840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505894-0fa9-4928-979a-eb612c8273c3 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.508840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505894-0fa9-4928-979a-eb612c8273c3 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.516865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 74/155] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:45:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:58.520850 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26505894-0fa9-4928-979a-eb612c8273c3 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.548803 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.617775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 82/156] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:58.619259 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb566f5-a6be-4adc-9653-607bf8722042 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.619549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb566f5-a6be-4adc-9653-607bf8722042 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.619824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb566f5-a6be-4adc-9653-607bf8722042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.672057 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-4eb566f5-a6be-4adc-9653-607bf8722042 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:58.673538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4eb566f5-a6be-4adc-9653-607bf8722042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:58.736697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26505894-0fa9-4928-979a-eb612c8273c3 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.801191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.801814 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.802097 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.802369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.803610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:58.803994 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.805469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.825767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 75/157] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:58.826610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.854276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 83/158] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:58.855202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb566f5-a6be-4adc-9653-607bf8722042 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.943022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.020585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ca4a-257e-4067-a924-1248fd117c5b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.081925 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.082933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.083500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.083975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.088601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.094178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb566f5-a6be-4adc-9653-607bf8722042 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.105431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:59.110980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:59.111939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:59.112725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:59.120753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 76/159] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:59.127687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.183850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.184514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.184795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.185066 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.191841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.193366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.194943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 84/160] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:59.201872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.289072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded22d1-b565-4463-a15b-34d629544dda None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.314047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.340104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.341179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.341748 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.342229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.343165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:59.344081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.346726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.370389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 77/161] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:59.371715 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.402033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc396418-9c55-4a01-95bd-c6eecf3e5552 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.437104 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.437987 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.438397 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.438793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.475513 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.510105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.511913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.541462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da47162-1f9f-454f-b96f-11e8905c9d64 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.588117 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.589019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.589448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.589978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.601470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:59.607919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:59.609007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:59.609984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:59.611908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 78/162] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:59.612980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.659051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 85/163] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:59.666202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.690303 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.794818 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bbc12-4ec7-4918-b697-28c6c1f5e007 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.806491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.836457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.837100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.837773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.838067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.860096 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:59.865836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:59.866949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:45:59.867811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 79/164] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:59.869095 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.878435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bef6-9cd8-4d98-98f7-e947d930295c None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.959844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.960509 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.960791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.961069 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.962832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.964335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.966116 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 86/165] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:59.966731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.042983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.049399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430e27-fd44-4058-84ab-758ea8cee2fb None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.088429 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0df70-4fa8-4ca8-a93a-cdb746d3b65d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.114198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.115093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.115530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.115943 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.116760 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.117203 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.119338 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.138576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 80/166] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.141533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.162226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.163179 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.163625 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.164042 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.166109 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.169481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.172217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 87/167] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.173407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.183522 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.337945 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6347bd2-4d8a-40c2-a916-0b6f761613d2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.365320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9f7c-f79c-4a37-b6c0-9ee7fc66d2fb None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.395205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.396160 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.396582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.397004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.397829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.398329 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.400444 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.417969 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 81/168] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.420067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.427996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f83d09-13cf-4f73-98be-7f81eedb669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.428911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83d09-13cf-4f73-98be-7f81eedb669d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.429345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83d09-13cf-4f73-98be-7f81eedb669d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.429843 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83d09-13cf-4f73-98be-7f81eedb669d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.469304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.563324 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f83d09-13cf-4f73-98be-7f81eedb669d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.564811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f83d09-13cf-4f73-98be-7f81eedb669d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.579488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.615617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260919-bf74-4fa3-bbf5-d0e070b460f1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.654384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.655064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.655367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.655645 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] PATH_INFO: `/v3/users/00caaefe5f7440c9962342f8ae00dd35` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.656884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] RBAC: Authorizing `identity:get_user(user_id=00caaefe5f7440c9962342f8ae00dd35)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.664415 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.668071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 82/169] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/users/00caaefe5f7440c9962342f8ae00dd35 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.669027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.694063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 88/170] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:00.695375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe419e-2d00-457f-a885-d4348c1b824b None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.695660 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe419e-2d00-457f-a885-d4348c1b824b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.695934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe419e-2d00-457f-a885-d4348c1b824b None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.698133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 89/171] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:00.698865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe419e-2d00-457f-a885-d4348c1b824b None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.784041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.793791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8f447-421c-44c4-880c-e3c366cdce2f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.815605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe419e-2d00-457f-a885-d4348c1b824b None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.818053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.833616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6509-7540-4ef2-8703-dcb878b38f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.834277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6509-7540-4ef2-8703-dcb878b38f32 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.834502 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6509-7540-4ef2-8703-dcb878b38f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.834775 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6509-7540-4ef2-8703-dcb878b38f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.835591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6509-7540-4ef2-8703-dcb878b38f32 None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=b16bbf73d702424c9a4d703e49d68880) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.835898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6509-7540-4ef2-8703-dcb878b38f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.838138 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6509-7540-4ef2-8703-dcb878b38f32 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.845446 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 83/172] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/role_assignments?user.id=b16bbf73d702424c9a4d703e49d68880&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.846701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d7bd-9f86-40c3-ab11-b56c8432a3ac None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.846981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d7bd-9f86-40c3-ab11-b56c8432a3ac None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.847341 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d7bd-9f86-40c3-ab11-b56c8432a3ac None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.848821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 84/173] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:00.849606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1d7bd-9f86-40c3-ab11-b56c8432a3ac None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.876040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2a226-63aa-441a-887a-e007bcdc90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.876616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a226-63aa-441a-887a-e007bcdc90d8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.876900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a226-63aa-441a-887a-e007bcdc90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.877218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a226-63aa-441a-887a-e007bcdc90d8 None admin] PATH_INFO: `/v3/users/b16bbf73d702424c9a4d703e49d68880` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.878433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2a226-63aa-441a-887a-e007bcdc90d8 None admin] RBAC: Authorizing `identity:get_user(user_id=b16bbf73d702424c9a4d703e49d68880)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.879918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2a226-63aa-441a-887a-e007bcdc90d8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.881830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 90/174] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/users/b16bbf73d702424c9a4d703e49d68880 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.882981 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db829a-65c2-4932-bf72-5247f157b760 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.883290 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db829a-65c2-4932-bf72-5247f157b760 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.883565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db829a-65c2-4932-bf72-5247f157b760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.930437 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d0db829a-65c2-4932-bf72-5247f157b760 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:00.931767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d0db829a-65c2-4932-bf72-5247f157b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:01.051610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1d7bd-9f86-40c3-ab11-b56c8432a3ac None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.079249 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 91/175] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:01.080196 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db829a-65c2-4932-bf72-5247f157b760 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.102580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.104032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.104472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.105219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.137211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.186364 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.188076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.242511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db829a-65c2-4932-bf72-5247f157b760 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.247239 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.284892 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cf1c3-d981-4b3a-a866-8e40e08fc003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.285530 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf1c3-d981-4b3a-a866-8e40e08fc003 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.285813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf1c3-d981-4b3a-a866-8e40e08fc003 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.286088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cf1c3-d981-4b3a-a866-8e40e08fc003 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.287254 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cf1c3-d981-4b3a-a866-8e40e08fc003 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.288768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cf1c3-d981-4b3a-a866-8e40e08fc003 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.296360 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 92/176] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:01.297627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbb76-a3cd-40b0-b4b9-2d9b87221cda None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.297911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbb76-a3cd-40b0-b4b9-2d9b87221cda None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.298189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbb76-a3cd-40b0-b4b9-2d9b87221cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.313738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 85/177] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:01.313738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.316832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-8fbcbb76-a3cd-40b0-b4b9-2d9b87221cda None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:01.318028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8fbcbb76-a3cd-40b0-b4b9-2d9b87221cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:01.377465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.390469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 93/178] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:01.391697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3bfcd-a9b3-475f-8ffe-a5ba7412bcdf None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.391989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3bfcd-a9b3-475f-8ffe-a5ba7412bcdf None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.392264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3bfcd-a9b3-475f-8ffe-a5ba7412bcdf None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.393536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 94/179] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:01.394560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566b975-9c16-4975-825d-dbfdb597753f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.394838 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566b975-9c16-4975-825d-dbfdb597753f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.395128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566b975-9c16-4975-825d-dbfdb597753f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.401278 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 95/180] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:01.401278 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566b975-9c16-4975-825d-dbfdb597753f None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.430763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747319a-474c-436b-8ac3-ff00f03eda97 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.470630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773e5bc-379b-489e-b0b1-51bba9466dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.471301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e5bc-379b-489e-b0b1-51bba9466dba None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.471582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e5bc-379b-489e-b0b1-51bba9466dba None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.471852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e5bc-379b-489e-b0b1-51bba9466dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.519668 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.523652 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566b975-9c16-4975-825d-dbfdb597753f None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.549168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773e5bc-379b-489e-b0b1-51bba9466dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.550759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773e5bc-379b-489e-b0b1-51bba9466dba None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.558595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.559227 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.559502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.559768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.560495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] RBAC: Adding query filter params (role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=b16bbf73d702424c9a4d703e49d68880) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:01.560795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.562230 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.575545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 96/181] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/role_assignments?user.id=b16bbf73d702424c9a4d703e49d68880&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:01.577309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.634845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.702513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 86/182] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:01.704381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718585-0659-4b29-ad75-042d8651bdab None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.704670 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718585-0659-4b29-ad75-042d8651bdab None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.704951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718585-0659-4b29-ad75-042d8651bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.714394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbba09-eb7d-4bc7-87b2-377507c0d2ae None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.726419 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-ec718585-0659-4b29-ad75-042d8651bdab None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:01.728141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-ec718585-0659-4b29-ad75-042d8651bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:01.754997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8f33c-37a9-489f-9e36-9edb2d576935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.755800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8f33c-37a9-489f-9e36-9edb2d576935 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.756080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8f33c-37a9-489f-9e36-9edb2d576935 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.756353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8f33c-37a9-489f-9e36-9edb2d576935 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.757504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8f33c-37a9-489f-9e36-9edb2d576935 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.759065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8f33c-37a9-489f-9e36-9edb2d576935 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.761456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 97/183] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:01.763172 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e86d1-8709-41b7-9423-aeddcf81fd93 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.763172 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e86d1-8709-41b7-9423-aeddcf81fd93 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.763370 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e86d1-8709-41b7-9423-aeddcf81fd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.781574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-7a0e86d1-8709-41b7-9423-aeddcf81fd93 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:01.782784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-7a0e86d1-8709-41b7-9423-aeddcf81fd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:01.811192 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 87/184] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:01.812351 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.812618 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718585-0659-4b29-ad75-042d8651bdab None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.856510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 98/185] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:01.857363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e86d1-8709-41b7-9423-aeddcf81fd93 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.925614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.942561 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718585-0659-4b29-ad75-042d8651bdab None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.984561 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.985199 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.985474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.985747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.000222 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:02.000931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e86d1-8709-41b7-9423-aeddcf81fd93 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:02.006339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:02.007542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 88/186] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:02.013141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.050070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.051338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.051810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.052343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.066418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:02.073190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:02.074045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:02.074842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:02.077911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 99/187] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:02.078744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.106944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.128596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059a1df-9624-4a5a-9e72-4e1e22b32d95 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.164207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.164841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.165115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.165422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] PATH_INFO: `/v3/projects/979a5f18b88a4fc48a99e4001eadaf80` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.166577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] RBAC: Authorizing `identity:get_project(project_id=979a5f18b88a4fc48a99e4001eadaf80)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.168059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.169699 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 89/188] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/projects/979a5f18b88a4fc48a99e4001eadaf80 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.170473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.187775 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.189325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf52cbc-dad6-4ec9-a7b7-a2fd9e046e54 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.224983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.225508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.225782 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.226052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.226779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=00caaefe5f7440c9962342f8ae00dd35) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:02.227229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.229221 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.235519 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 100/189] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/role_assignments?user.id=00caaefe5f7440c9962342f8ae00dd35&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.236351 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.294625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5edcc0-94fb-493c-a86b-b55d67713323 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.332220 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.332848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.333120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.333388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.334068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:02.334368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.335798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.345783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 90/190] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.345783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.356692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.374844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb5b86-e59f-4626-870b-b995b1069180 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.414971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.415711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.415994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.416262 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.417127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:02.417428 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.418828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.427605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 101/191] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.438958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.465877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9daa6-246d-43ee-956a-852e4572285d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.503049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.503633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.503907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.504176 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.505267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.506698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.508287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 91/192] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.511949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.547605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f02f5-675b-4ebd-9be9-03fa97c09137 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.581405 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.582039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.582311 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.582589 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.593262 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:02.598789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:02.599744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:02.600551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 102/193] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:02.601209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.613073 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.615196 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1fc9-bd64-432b-823e-d5c3610a43bc None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.653164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.653779 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.654053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.654320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.655054 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=979a5f18b88a4fc48a99e4001eadaf80, user.id=b16bbf73d702424c9a4d703e49d68880) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:02.655380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.656823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.662901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 92/194] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/role_assignments?user.id=b16bbf73d702424c9a4d703e49d68880&scope.project.id=979a5f18b88a4fc48a99e4001eadaf80&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.672888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.686830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.718846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f615ff8-0df4-4d4f-9545-421e51d53ccd None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.757485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.758051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.758366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.758590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] PATH_INFO: `/v3/users/97668602fac54cc3aa0f465b04820434` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.760396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] RBAC: Authorizing `identity:get_user(user_id=97668602fac54cc3aa0f465b04820434)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.761887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.763583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 103/195] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/users/97668602fac54cc3aa0f465b04820434 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.764365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.798539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff2f66-dcd8-407a-94a7-19e7216aaf24 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.844678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.845615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.845898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.846174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] PATH_INFO: `/v3/users/928c464099324274b18f59261b03957e` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.856898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.864864 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] RBAC: Authorizing `identity:get_user(user_id=928c464099324274b18f59261b03957e)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.866024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.868107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 93/196] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/users/928c464099324274b18f59261b03957e => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.869412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.896198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de737f9-9714-4063-b5fb-521976955827 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.932661 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.933284 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.933563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.933836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.934494 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.935995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.938412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.973427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb3d7a-8088-4ac5-bde3-8ee99327d729 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.007957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.008493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.008774 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.009635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.010345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:03.010643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.012066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.014874 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 104/197] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:02 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:03.015762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.026677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 94/198] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:03.027949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.140382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05e4eb-8d56-43ec-a498-5d91ecaeb2d9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.157328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b55af-66c3-4ebd-bb19-5e85b5cac647 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.175741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.181590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.182224 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.182501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.182768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.194628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.204525 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.205296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.205580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.205859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.271480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.273029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.299901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.301376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.411275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 105/199] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:03.412396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.443239 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 95/200] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:03.444447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.507497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.539237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7eb5-bcea-4d13-ad81-7b047945e1f1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.581284 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d359-f400-4e09-a435-50942af4afb3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.584530 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.585439 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.585982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.586457 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] PATH_INFO: `/v3/users/928c464099324274b18f59261b03957e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.588887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] RBAC: Authorizing `identity:get_user(user_id=928c464099324274b18f59261b03957e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.590597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.592491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 106/201] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/users/928c464099324274b18f59261b03957e => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:03.594020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.637414 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.638456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.638456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.638647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.640782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.641716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.643416 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 96/202] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:03.644079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.724307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b6ae-3b30-473f-9fd5-a7c28d8520b1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.747534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.761466 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.762211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.765166 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.765166 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.765166 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.765718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.771316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 107/203] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:03.773041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.776204 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.783512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10831c-2135-47a9-9e94-0339bc80a1b2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.824032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.825064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.825536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.826118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.889841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3f21-e2e2-4d89-808c-918632e3bf83 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.901453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.903293 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.926657 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.927318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.927620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.927871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.928597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] RBAC: Adding query filter params (role.id=9eb4e632f5fd40cfa2d008c4408aa72e, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5, user.id=97668602fac54cc3aa0f465b04820434) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:03.928904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.930677 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.937327 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 108/204] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/role_assignments?user.id=97668602fac54cc3aa0f465b04820434&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=9eb4e632f5fd40cfa2d008c4408aa72e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:03.938202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.975078 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.012553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.019705 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 97/205] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:04.026208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.056907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d410883-da7d-46b6-b998-3aa9f751a8dc None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.148170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.148707 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.149053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.149314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.150681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=928c464099324274b18f59261b03957e) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:04.151425 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.152870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.160447 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 109/206] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/role_assignments?user.id=928c464099324274b18f59261b03957e&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:04.199024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f134b-4928-4070-8298-a5c4b091fc26 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.254303 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23751876-2849-4f85-a3af-1c4d982e06fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.254964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751876-2849-4f85-a3af-1c4d982e06fc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.255271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751876-2849-4f85-a3af-1c4d982e06fc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.255549 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751876-2849-4f85-a3af-1c4d982e06fc None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.256747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23751876-2849-4f85-a3af-1c4d982e06fc None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.258281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23751876-2849-4f85-a3af-1c4d982e06fc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.260654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 98/207] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:04.266797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.401277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.408464 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811c06-6eee-457f-bfd4-f102900a3b04 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.474335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefb71d-e463-4a9f-a181-ffb063a893d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.475872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefb71d-e463-4a9f-a181-ffb063a893d9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.476659 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefb71d-e463-4a9f-a181-ffb063a893d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.477364 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefb71d-e463-4a9f-a181-ffb063a893d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.479025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefb71d-e463-4a9f-a181-ffb063a893d9 None admin] RBAC: Adding query filter params (role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=928c464099324274b18f59261b03957e) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:04.479882 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefb71d-e463-4a9f-a181-ffb063a893d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.482917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefb71d-e463-4a9f-a181-ffb063a893d9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.496107 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 110/208] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/role_assignments?user.id=928c464099324274b18f59261b03957e&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:05.229749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2220-edd6-4a66-8045-7ade77c85971 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.230289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2220-edd6-4a66-8045-7ade77c85971 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.230289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2220-edd6-4a66-8045-7ade77c85971 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.231814 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 99/209] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:05.237507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f2f55-0522-42f2-a02f-f43a485e33f9 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.238361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f2f55-0522-42f2-a02f-f43a485e33f9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.238864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f2f55-0522-42f2-a02f-f43a485e33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.253601 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226830-a41e-4eae-b064-ed00101a58b5 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.254217 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226830-a41e-4eae-b064-ed00101a58b5 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.254703 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226830-a41e-4eae-b064-ed00101a58b5 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.256368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 100/210] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:05.262735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fef0b-67cb-45b0-ad53-2d7d870b7780 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.263351 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fef0b-67cb-45b0-ad53-2d7d870b7780 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.263839 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fef0b-67cb-45b0-ad53-2d7d870b7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.265148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-160f2f55-0522-42f2-a02f-f43a485e33f9 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:05.266368 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-160f2f55-0522-42f2-a02f-f43a485e33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:05.285472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-932fef0b-67cb-45b0-ad53-2d7d870b7780 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:05.287219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-932fef0b-67cb-45b0-ad53-2d7d870b7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:05.355143 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 111/211] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:05.365057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:05.374263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 101/212] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:05.633354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f2f55-0522-42f2-a02f-f43a485e33f9 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.662053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fef0b-67cb-45b0-ad53-2d7d870b7780 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.761712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:05.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f2f55-0522-42f2-a02f-f43a485e33f9 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.814361 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fef0b-67cb-45b0-ad53-2d7d870b7780 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.822243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.822984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.823398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.823735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.825742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:05.827797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.834408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 112/213] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:05.836035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.857680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.858323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.858770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.859043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.873123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:05.879268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:05.880237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:05.881062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 102/214] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:05.888567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.956232 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:05.970022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e606a-94cb-4b09-a170-2d6b1cf5855f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.005560 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e720e-1ca9-4402-978b-e9ed9072a1f5 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.006498 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.007249 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.007641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.008056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.009296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.011132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.047602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.048274 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.048553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.048826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.049529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:06.049834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.051240 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.061109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 103/215] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:06.066694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:06.108399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 113/216] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:05 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:06.192000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652c21-81d7-4ac7-8cff-36d3c7f3175d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.214056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:06.235576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778b9cd-8e63-491b-961b-2c00797bdd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.237072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b9cd-8e63-491b-961b-2c00797bdd39 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.237606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b9cd-8e63-491b-961b-2c00797bdd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.238148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b9cd-8e63-491b-961b-2c00797bdd39 None admin] PATH_INFO: `/v3/users/32e39c90a1c74320a7554fd1010b44a3` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.255541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778b9cd-8e63-491b-961b-2c00797bdd39 None admin] RBAC: Authorizing `identity:get_user(user_id=32e39c90a1c74320a7554fd1010b44a3)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.257673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778b9cd-8e63-491b-961b-2c00797bdd39 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.260354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 104/217] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:06 2022] GET /identity/v3/users/32e39c90a1c74320a7554fd1010b44a3 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:06.267874 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:06.286690 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:06.405827 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a3d3-7420-4494-a816-918398a05ce9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.447206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.447918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.448201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.448477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.536671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab156e-ef33-4b41-8651-c9958fb22412 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.537012 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab156e-ef33-4b41-8651-c9958fb22412 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.537220 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab156e-ef33-4b41-8651-c9958fb22412 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.538898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 105/218] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:06.541610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.543792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.545858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d2968-c9fb-4e2b-a09d-407e9b51cb36 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.546213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d2968-c9fb-4e2b-a09d-407e9b51cb36 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.546494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d2968-c9fb-4e2b-a09d-407e9b51cb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.564218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:06.580578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-520d2968-c9fb-4e2b-a09d-407e9b51cb36 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:06.581821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-520d2968-c9fb-4e2b-a09d-407e9b51cb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:06.667526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 106/219] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:06.684257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 114/220] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:06.690158 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d2968-c9fb-4e2b-a09d-407e9b51cb36 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:06.811371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d2968-c9fb-4e2b-a09d-407e9b51cb36 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.816093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:06.860703 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.861757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.862066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.862346 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.863583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.865041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.866848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 107/221] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:06 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:06.873275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.010126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c699-1bf0-4899-adaf-61fb5de4b28f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.028131 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:07.052376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37de5f7-49be-467a-a131-cd06587e505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:07.053839 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37de5f7-49be-467a-a131-cd06587e505d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.054532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37de5f7-49be-467a-a131-cd06587e505d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.055211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37de5f7-49be-467a-a131-cd06587e505d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.056449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37de5f7-49be-467a-a131-cd06587e505d None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=32e39c90a1c74320a7554fd1010b44a3) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:07.057041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37de5f7-49be-467a-a131-cd06587e505d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:07.058853 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37de5f7-49be-467a-a131-cd06587e505d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:07.068541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 115/222] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:06 2022] GET /identity/v3/role_assignments?user.id=32e39c90a1c74320a7554fd1010b44a3&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:07.099281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.200312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65617ad-651f-44c2-925e-60b1f3a1e156 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.201325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65617ad-651f-44c2-925e-60b1f3a1e156 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.201873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65617ad-651f-44c2-925e-60b1f3a1e156 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.204335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 116/223] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:07.213867 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d51b1-2b5f-458d-b7ed-7a703d4cfdad None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.214541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d51b1-2b5f-458d-b7ed-7a703d4cfdad None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.215041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d51b1-2b5f-458d-b7ed-7a703d4cfdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.242864 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df08a-6e93-48aa-a3ed-bad521541234 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.251862 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-a95d51b1-2b5f-458d-b7ed-7a703d4cfdad None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:07.253440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-a95d51b1-2b5f-458d-b7ed-7a703d4cfdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:07.278840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:07.279536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.279815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.280086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.292744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:07.297820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:07.299395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:07.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 108/224] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:07.305115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.361895 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:07.407031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 117/225] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:07.459823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a1cc-74d2-4966-89c4-66121c7cd04a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.497872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:07.498489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.498765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.499038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.499746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:07.500042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:07.501417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:07.510272 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 109/226] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:07.515846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d51b1-2b5f-458d-b7ed-7a703d4cfdad None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.640736 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d51b1-2b5f-458d-b7ed-7a703d4cfdad None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.655826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:07.689902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:07.690557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.690833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.691126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] PATH_INFO: `/v3/users/928c464099324274b18f59261b03957e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.692347 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=928c464099324274b18f59261b03957e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:07.693934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:07.695874 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 118/227] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:07 2022] GET /identity/v3/users/928c464099324274b18f59261b03957e => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:07.702008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.802888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:07.810545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7c39-54bf-44c7-b3a9-77a7e1bb37ed None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.850702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:07.851389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.851668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.851940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.853257 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:07.854948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:07.856636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 110/228] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:07 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:07.862488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.910099 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.041721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ba60-75b5-404d-9b43-f783886e53c4 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.049357 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268865f-2b6b-4a96-8cff-3e668b99b1b8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.077290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.078044 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.078332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.078607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.089858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:08.095639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:08.096529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:08.097335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:08.101867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 111/229] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:08.104112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.131447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.140570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.142538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.142538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.142538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/928c464099324274b18f59261b03957e/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.150849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f1e914fe128421190cf9ad952d634c0, user_id=928c464099324274b18f59261b03957e, role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.152335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.222908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d59184-1531-4c93-a5a6-3cfe7a85bed6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.232903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 119/230] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:07 2022] PUT /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/928c464099324274b18f59261b03957e/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:08.267813 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.268643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.268921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.269192 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.269886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:08.270186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.271669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.286762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 112/231] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:08.288252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.336558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.431620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d430-8227-4d42-bb62-d66b4e1c7060 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.474812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.475398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.475675 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.475945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] PATH_INFO: `/v3/users/928c464099324274b18f59261b03957e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.477087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] RBAC: Authorizing `identity:get_user(user_id=928c464099324274b18f59261b03957e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.479246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.483620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 120/232] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/users/928c464099324274b18f59261b03957e => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:08.486924 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.581793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.599544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acdfea-2353-4868-8728-dacf96ab7d32 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.637742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e198a-1d73-4825-bc3d-564e0c606f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.638387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e198a-1d73-4825-bc3d-564e0c606f48 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.638667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e198a-1d73-4825-bc3d-564e0c606f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.638943 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e198a-1d73-4825-bc3d-564e0c606f48 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.640186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e198a-1d73-4825-bc3d-564e0c606f48 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.641766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e198a-1d73-4825-bc3d-564e0c606f48 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.643788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 113/233] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:08.651746 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.813236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7647-1dfa-4d86-9cab-506e2d380049 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.820143 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.856614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386882-fc7d-4e3f-a647-08a39707d69c None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.857300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386882-fc7d-4e3f-a647-08a39707d69c None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.857801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386882-fc7d-4e3f-a647-08a39707d69c None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.861266 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 114/234] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:08.862975 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ba05-746b-47b7-80c7-2d5f8343633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.863687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ba05-746b-47b7-80c7-2d5f8343633b None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.864043 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ba05-746b-47b7-80c7-2d5f8343633b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.864232 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ba05-746b-47b7-80c7-2d5f8343633b None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/928c464099324274b18f59261b03957e/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.869425 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ba05-746b-47b7-80c7-2d5f8343633b None admin] RBAC: Authorizing `identity:create_grant(project_id=2f1e914fe128421190cf9ad952d634c0, user_id=928c464099324274b18f59261b03957e, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.870895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ba05-746b-47b7-80c7-2d5f8343633b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.877525 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007318-1212-43fc-965e-709b721e54fc None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.877804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007318-1212-43fc-965e-709b721e54fc None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.878121 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007318-1212-43fc-965e-709b721e54fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.897578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-74007318-1212-43fc-965e-709b721e54fc None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:08.898957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-74007318-1212-43fc-965e-709b721e54fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:08.975065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 121/235] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:08 2022] PUT /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/928c464099324274b18f59261b03957e/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:08.976003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 115/236] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:46:08.979579 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e1fbb-f399-4071-9274-103978143ebe None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.980176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e1fbb-f399-4071-9274-103978143ebe None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.980638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e1fbb-f399-4071-9274-103978143ebe None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.987358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 122/237] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:08.989659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59286ec-b816-4ec7-ab61-d7090522dc72 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.990299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59286ec-b816-4ec7-ab61-d7090522dc72 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.990785 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59286ec-b816-4ec7-ab61-d7090522dc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.013893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-e59286ec-b816-4ec7-ab61-d7090522dc72 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:09.015763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-e59286ec-b816-4ec7-ab61-d7090522dc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:09.099651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 116/238] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:46:09.280010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e1fbb-f399-4071-9274-103978143ebe None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.419849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e1fbb-f399-4071-9274-103978143ebe None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.423445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59286ec-b816-4ec7-ab61-d7090522dc72 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.437845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.474618 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.475317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.475554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.475823 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.500175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:09.505320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:09.506218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:09.507059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:09.508131 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 123/239] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:09.512702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.566502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.580368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59286ec-b816-4ec7-ab61-d7090522dc72 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.632961 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.633627 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.633904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.634179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.635390 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.636853 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.638466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 117/240] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:09.644142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.740211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.763721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66817f-7ef2-4903-ab33-3abbc29377c3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.774548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84346418-f275-4a3a-accf-de5e7c1caa33 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.800908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c085dc-9a2b-4f11-acb9-5b1c8eb9cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.801527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c085dc-9a2b-4f11-acb9-5b1c8eb9cf19 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.801801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c085dc-9a2b-4f11-acb9-5b1c8eb9cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.802073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c085dc-9a2b-4f11-acb9-5b1c8eb9cf19 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.802727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c085dc-9a2b-4f11-acb9-5b1c8eb9cf19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.804237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c085dc-9a2b-4f11-acb9-5b1c8eb9cf19 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.811725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d417a18-7d25-45c4-932e-421297c6aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.812558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417a18-7d25-45c4-932e-421297c6aa31 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.812949 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417a18-7d25-45c4-932e-421297c6aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.813409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417a18-7d25-45c4-932e-421297c6aa31 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.814176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d417a18-7d25-45c4-932e-421297c6aa31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:09.814666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d417a18-7d25-45c4-932e-421297c6aa31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.816276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d417a18-7d25-45c4-932e-421297c6aa31 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.826000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 124/241] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:09.827343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0dc14-7b71-4a7b-8426-7980be472030 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.831861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0dc14-7b71-4a7b-8426-7980be472030 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.831861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0dc14-7b71-4a7b-8426-7980be472030 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.831861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 125/242] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:09.832085 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0dc14-7b71-4a7b-8426-7980be472030 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.887507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 118/243] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:09 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:46:09.888934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9066-fbd3-4a5f-9661-8e73ac274aba None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.889219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9066-fbd3-4a5f-9661-8e73ac274aba None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.889565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9066-fbd3-4a5f-9661-8e73ac274aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.928085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c2ff9066-fbd3-4a5f-9661-8e73ac274aba None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:09.934943 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c2ff9066-fbd3-4a5f-9661-8e73ac274aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:09.940551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.960793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0dc14-7b71-4a7b-8426-7980be472030 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.004770 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.005329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.005603 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.005873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] PATH_INFO: `/v3/users/83c6418715b74c918345cd9d2b78ba79` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.023403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] RBAC: Authorizing `identity:get_user(user_id=83c6418715b74c918345cd9d2b78ba79)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.025642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.027738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 126/244] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/users/83c6418715b74c918345cd9d2b78ba79 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:10.034358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.130349 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 119/245] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:10.167522 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4315-883e-4441-bdf8-a87fc820606d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.214425 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.215469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.215893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.216332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.233544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:10.299213 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.301054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.432891 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 127/246] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:10.438732 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9066-fbd3-4a5f-9661-8e73ac274aba None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.472748 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.535473 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:10.548304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:10.597176 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9066-fbd3-4a5f-9661-8e73ac274aba None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.608917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09cea1-176e-40e8-9374-6da942307ff8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.658174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.658847 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.659146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.659430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.661264 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.662780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.664011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.665469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.666092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.666650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.671421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 120/247] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:10.680196 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.686734 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:10.692665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:10.693773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:10.694811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 128/248] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:10.709129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.821017 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4198dd-5b9b-4182-895c-23e8dcbbbf10 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.862855 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b8f8-2652-4225-a67b-b5578ca97955 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.863791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60e407-a2a9-4313-941e-e4c1ae0adcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.864930 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e407-a2a9-4313-941e-e4c1ae0adcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.865411 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e407-a2a9-4313-941e-e4c1ae0adcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.865902 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e407-a2a9-4313-941e-e4c1ae0adcc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.866837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60e407-a2a9-4313-941e-e4c1ae0adcc3 None admin] RBAC: Adding query filter params (role.id=9eb4e632f5fd40cfa2d008c4408aa72e, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=83c6418715b74c918345cd9d2b78ba79) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:10.868996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:10.869997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60e407-a2a9-4313-941e-e4c1ae0adcc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.871724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60e407-a2a9-4313-941e-e4c1ae0adcc3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.873956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:10.879281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 121/249] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/role_assignments?user.id=83c6418715b74c918345cd9d2b78ba79&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=9eb4e632f5fd40cfa2d008c4408aa72e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:10.880718 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158912d-fa9c-4ae1-8d0f-d0da546f0f59 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.891237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158912d-fa9c-4ae1-8d0f-d0da546f0f59 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.891237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158912d-fa9c-4ae1-8d0f-d0da546f0f59 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.891237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 122/250] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:10.893874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a33ed-55e0-48e4-bbad-d27fcae8c263 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.894362 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a33ed-55e0-48e4-bbad-d27fcae8c263 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.894837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a33ed-55e0-48e4-bbad-d27fcae8c263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.924426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-978a33ed-55e0-48e4-bbad-d27fcae8c263 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:10.925625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-978a33ed-55e0-48e4-bbad-d27fcae8c263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:10.945296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.945936 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.946900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.947197 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.949076 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:10.949379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.950807 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.969874 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 129/251] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:10.978611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:11.076177 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 123/252] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:11.137219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31041b8a-af22-444c-a080-f4bb537d9e89 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:11.178728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:11.179802 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.180307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.181382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] PATH_INFO: `/v3/users/32e39c90a1c74320a7554fd1010b44a3` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.187921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] RBAC: Authorizing `identity:get_user(user_id=32e39c90a1c74320a7554fd1010b44a3)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:11.189702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:11.192022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 130/253] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/users/32e39c90a1c74320a7554fd1010b44a3 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:11.197868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a33ed-55e0-48e4-bbad-d27fcae8c263 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:11.332272 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a33ed-55e0-48e4-bbad-d27fcae8c263 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:11.367765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:11.377619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80fb1-0237-471d-bd0d-47f5a1de5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:11.378302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80fb1-0237-471d-bd0d-47f5a1de5c86 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.378577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80fb1-0237-471d-bd0d-47f5a1de5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.378848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80fb1-0237-471d-bd0d-47f5a1de5c86 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.379996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80fb1-0237-471d-bd0d-47f5a1de5c86 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:11.381447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80fb1-0237-471d-bd0d-47f5a1de5c86 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:11.383240 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 124/254] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:11 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:11.390278 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:11.441077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:11.512775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847631b3-1150-4e1d-8223-4f5a672c4197 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:11.549618 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbf39-1d86-4a3b-9857-cbb1095013f9 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.550157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbf39-1d86-4a3b-9857-cbb1095013f9 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.550157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbf39-1d86-4a3b-9857-cbb1095013f9 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.551804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 125/255] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:11.555136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:11.557004 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.557492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.557683 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd7337-b1d0-4893-a2b3-5408bd09cece None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.557966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd7337-b1d0-4893-a2b3-5408bd09cece None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.558240 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd7337-b1d0-4893-a2b3-5408bd09cece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.558579 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/32e39c90a1c74320a7554fd1010b44a3/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.562758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f1e914fe128421190cf9ad952d634c0, user_id=32e39c90a1c74320a7554fd1010b44a3, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:11.564247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:11.592915 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-3efd7337-b1d0-4893-a2b3-5408bd09cece None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:11.594489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-3efd7337-b1d0-4893-a2b3-5408bd09cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:11.642382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 131/256] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:11 2022] PUT /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/32e39c90a1c74320a7554fd1010b44a3/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:11.643248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:11.720134 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 126/257] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:46:11.830182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:11.837582 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b62ad-0144-4b2e-bf3e-41bc23ad29d3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:11.884552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:11.885274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.885557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.885833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.898888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:11.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:11.906889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:11.907760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 132/258] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:11.915071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd7337-b1d0-4893-a2b3-5408bd09cece None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.040420 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd7337-b1d0-4893-a2b3-5408bd09cece None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.076501 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.085240 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.085887 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.086169 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.086441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.087736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:12.088038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.089427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.098644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 127/259] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:12.107634 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.124464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.247286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416d93d-6af8-4c19-a3d0-2f71f537cc95 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.294726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.295566 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.295848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.296125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.317535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:12.324262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:12.325161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:12.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:12.331728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 128/260] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:12.338691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.358904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55d65c-30a4-4526-8705-f07122487476 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.445738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.467129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.467773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.468102 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.468641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] PATH_INFO: `/v3/users/928c464099324274b18f59261b03957e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.469797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] RBAC: Authorizing `identity:get_user(user_id=928c464099324274b18f59261b03957e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.471390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.472995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 133/261] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/users/928c464099324274b18f59261b03957e => generated 283 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:12.478759 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.535505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.581659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057552-cb13-43a8-ba93-07c44f9eebab None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.668097 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad733-1996-460b-b115-658d576af52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.668724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad733-1996-460b-b115-658d576af52f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.669033 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad733-1996-460b-b115-658d576af52f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.669261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad733-1996-460b-b115-658d576af52f None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.669938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bad733-1996-460b-b115-658d576af52f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:12.670238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bad733-1996-460b-b115-658d576af52f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.671651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bad733-1996-460b-b115-658d576af52f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.698258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 129/262] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:12.708433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad733-1996-460b-b115-658d576af52f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.725912 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068578d-0e9c-4ff1-b697-321497b7327c None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.788169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.788709 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.789111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.789385 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.936306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad733-1996-460b-b115-658d576af52f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.956656 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.964184 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.965744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.996105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.012818 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.013544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.013830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.014097 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] PATH_INFO: `/v3/users/928c464099324274b18f59261b03957e` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.015287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] RBAC: Authorizing `identity:get_user(user_id=928c464099324274b18f59261b03957e)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.016745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.018499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 130/263] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/users/928c464099324274b18f59261b03957e => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:13.026497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.125335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 134/264] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:13.131968 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.270870 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c89e92-16dd-4696-b89e-b37e934b2d83 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.322491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b755f-4e5f-4c8d-b349-173e8470a01d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.366959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.395215 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df31c5-f3f9-4831-b423-03d4e6acdb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.395215 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df31c5-f3f9-4831-b423-03d4e6acdb83 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.395215 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df31c5-f3f9-4831-b423-03d4e6acdb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.395215 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df31c5-f3f9-4831-b423-03d4e6acdb83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.403835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb81ed-cc58-4160-8c7f-0216ad504702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.404734 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb81ed-cc58-4160-8c7f-0216ad504702 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.405159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb81ed-cc58-4160-8c7f-0216ad504702 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.406137 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb81ed-cc58-4160-8c7f-0216ad504702 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.412255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb81ed-cc58-4160-8c7f-0216ad504702 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.414680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb81ed-cc58-4160-8c7f-0216ad504702 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.418275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 135/265] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:13.424653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2371c07-5083-48a7-883d-3781c08b6c23 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.425930 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2371c07-5083-48a7-883d-3781c08b6c23 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.426442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2371c07-5083-48a7-883d-3781c08b6c23 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.428125 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 136/266] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:13.429067 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2371c07-5083-48a7-883d-3781c08b6c23 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.499052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.528021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df31c5-f3f9-4831-b423-03d4e6acdb83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.530071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df31c5-f3f9-4831-b423-03d4e6acdb83 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.571854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2371c07-5083-48a7-883d-3781c08b6c23 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835441-ab7f-4124-8558-62126a630b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.611359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835441-ab7f-4124-8558-62126a630b5e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.611640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835441-ab7f-4124-8558-62126a630b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.611907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835441-ab7f-4124-8558-62126a630b5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.612628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835441-ab7f-4124-8558-62126a630b5e None admin] RBAC: Adding query filter params (role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=928c464099324274b18f59261b03957e) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:13.612926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835441-ab7f-4124-8558-62126a630b5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.614599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835441-ab7f-4124-8558-62126a630b5e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.621210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 137/267] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/role_assignments?user.id=928c464099324274b18f59261b03957e&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:13.621210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f900-e861-4c16-8609-6c657aab84d4 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.621210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f900-e861-4c16-8609-6c657aab84d4 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.621210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f900-e861-4c16-8609-6c657aab84d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.648134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-2fd3f900-e861-4c16-8609-6c657aab84d4 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:13.649497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-2fd3f900-e861-4c16-8609-6c657aab84d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:13.667300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 131/268] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:46:13.668719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091f18d-f2b0-4fd4-9500-d2a446601472 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.669000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091f18d-f2b0-4fd4-9500-d2a446601472 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.670147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091f18d-f2b0-4fd4-9500-d2a446601472 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.672130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 132/269] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:13.674769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163933a9-7213-41f2-a250-bd4ce30b3feb None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.675031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163933a9-7213-41f2-a250-bd4ce30b3feb None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.675757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163933a9-7213-41f2-a250-bd4ce30b3feb None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.678167 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 133/270] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:13.679755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163933a9-7213-41f2-a250-bd4ce30b3feb None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.734582 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.759610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 138/271] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:13.763621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb79af-27a2-4df0-a92a-6eb0730807fd None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.764187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb79af-27a2-4df0-a92a-6eb0730807fd None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.764665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb79af-27a2-4df0-a92a-6eb0730807fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.794387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-6ccb79af-27a2-4df0-a92a-6eb0730807fd None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:13.795778 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6ccb79af-27a2-4df0-a92a-6eb0730807fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:13.821844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.846193 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163933a9-7213-41f2-a250-bd4ce30b3feb None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.883272 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 139/272] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:13.885628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3585ea-84f8-407c-8381-a55883c26ea6 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.886050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3585ea-84f8-407c-8381-a55883c26ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.886483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3585ea-84f8-407c-8381-a55883c26ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.902137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.903046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.904581 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.905078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.908896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.910514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.919175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 134/273] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:13.923410 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.925269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0f3585ea-84f8-407c-8381-a55883c26ea6 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:13.928504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0f3585ea-84f8-407c-8381-a55883c26ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:14.071988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 140/274] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:14.106301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3585ea-84f8-407c-8381-a55883c26ea6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.119696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ffac-4742-4dae-98b1-3b6cc3c5b078 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:14.171659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:14.172490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.172912 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.175068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.176155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=928c464099324274b18f59261b03957e) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:14.176905 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:14.178492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:14.186298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 135/275] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/role_assignments?user.id=928c464099324274b18f59261b03957e&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:14.214915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:14.225302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.245224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:14.319044 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3585ea-84f8-407c-8381-a55883c26ea6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:14.368243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaacae-c890-49b9-b801-563fa1b12eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:14.369089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaacae-c890-49b9-b801-563fa1b12eea None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.369440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaacae-c890-49b9-b801-563fa1b12eea None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.369779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaacae-c890-49b9-b801-563fa1b12eea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.371740 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaacae-c890-49b9-b801-563fa1b12eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:14.374125 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaacae-c890-49b9-b801-563fa1b12eea None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:14.377163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 141/276] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:14.378771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aa87b-b490-44ff-bedc-f7c7b5a58e24 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.379137 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aa87b-b490-44ff-bedc-f7c7b5a58e24 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.379738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aa87b-b490-44ff-bedc-f7c7b5a58e24 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.386542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 142/277] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:14.386542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aa87b-b490-44ff-bedc-f7c7b5a58e24 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.404458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f1819-0990-410f-a1fe-63a37b216823 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:14.444092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71815-08ed-43c8-b7b8-b9de9b654d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:14.444669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71815-08ed-43c8-b7b8-b9de9b654d34 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.444953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71815-08ed-43c8-b7b8-b9de9b654d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.445229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71815-08ed-43c8-b7b8-b9de9b654d34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.457495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71815-08ed-43c8-b7b8-b9de9b654d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-67e71815-08ed-43c8-b7b8-b9de9b654d34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:14.464281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:14.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:14.466157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 136/278] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:14.466817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802b1f0-10c6-43fb-883b-fad19e2b8472 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.467804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802b1f0-10c6-43fb-883b-fad19e2b8472 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.467804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802b1f0-10c6-43fb-883b-fad19e2b8472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.486761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-4802b1f0-10c6-43fb-883b-fad19e2b8472 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:14.487989 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-4802b1f0-10c6-43fb-883b-fad19e2b8472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:14.511252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aa87b-b490-44ff-bedc-f7c7b5a58e24 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:14.524432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:14.547529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:14.548236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.548406 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.548675 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:14.550765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:14.551911 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:14.556855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 137/279] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:14.571798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802b1f0-10c6-43fb-883b-fad19e2b8472 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 143/280] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:14 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:14.656172 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.685566 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802b1f0-10c6-43fb-883b-fad19e2b8472 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:14.739257 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:14.740996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.741562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.742017 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.761112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:14.769069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:14.770062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:14.770889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:14.772690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 138/281] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:14.778422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.794308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7571-b505-4194-b669-831a6284505f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:14.835906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:14.837099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.837591 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.838163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.839245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:14.839548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:14.840985 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:14.850593 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:14.852767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 144/282] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:14.853947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.887396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:14.899555 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064243-465e-4373-9a4a-dda872381f24 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:14.945074 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:14.945845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.946315 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.946617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.947405 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:14.947710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:14.949106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:14.958811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 139/283] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:14.964683 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:14.975083 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53568f79-4c27-4a41-b6bf-1e9fe43a59e4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.023511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.024903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.025260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.025538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.039309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:15.045243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:15.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:15.047240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 145/284] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:15.047935 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.091770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47d2a9-b410-4f39-b1ce-d42d50f1b632 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.119479 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.132320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.132963 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.133312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] PATH_INFO: `/v3/users/fde0507eb57a40a39046ca01ced4613f` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.148335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] RBAC: Authorizing `identity:get_user(user_id=fde0507eb57a40a39046ca01ced4613f)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.150567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.157747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 140/285] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:14 2022] GET /identity/v3/users/fde0507eb57a40a39046ca01ced4613f => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:15.158747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.180962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.193790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ffe7c-a9a3-4ea7-b589-043060c9faa4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.242389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.244213 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.244573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.244859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] PATH_INFO: `/v3/users/83c6418715b74c918345cd9d2b78ba79` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.246678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] RBAC: Authorizing `identity:get_user(user_id=83c6418715b74c918345cd9d2b78ba79)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.248472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.251470 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 146/286] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/users/83c6418715b74c918345cd9d2b78ba79 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:15.252598 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.295842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bad05-ba86-4024-8933-bb55bf88ef62 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.343881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.344941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.345229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.345507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.346484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:15.346794 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.348249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.365659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 141/287] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:15.365659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.396646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52249d-c489-4908-820a-8a36cdeead75 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.420266 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.438340 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.438953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.439280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.439698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.440411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, user.id=fde0507eb57a40a39046ca01ced4613f, scope.system=all) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:15.440726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.442326 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.449325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 147/288] 10.222.0.58 () {56 vars in 1308 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/role_assignments?user.id=fde0507eb57a40a39046ca01ced4613f&scope.system=all&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:15.450158 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.482516 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.489495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2654f-1ffb-483a-b370-fb624b6b992a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.528497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.529505 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.530009 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.530476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.531876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.534042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.536026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 142/289] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:15.541961 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.598969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2641-a9ec-4a13-b48b-5a95cd8a7084 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.682788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.683491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.683774 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.684052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] PATH_INFO: `/v3/users/32e39c90a1c74320a7554fd1010b44a3` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.685944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] RBAC: Authorizing `identity:get_user(user_id=32e39c90a1c74320a7554fd1010b44a3)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.687431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.689031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 148/290] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/users/32e39c90a1c74320a7554fd1010b44a3 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:15.694900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.809063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f47b8-b60e-4bf9-b871-89b9da40405b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.809595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.820299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65168fb3-c74a-4e18-8dd4-908bd581fa05 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.834458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.863324 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.864493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.864965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.865432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/83c6418715b74c918345cd9d2b78ba79/roles/9eb4e632f5fd40cfa2d008c4408aa72e` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.867617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] RBAC: Authorizing `identity:create_grant(project_id=2f1e914fe128421190cf9ad952d634c0, user_id=83c6418715b74c918345cd9d2b78ba79, role_id=9eb4e632f5fd40cfa2d008c4408aa72e)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.870001 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.889908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.890916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.891426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.891915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.941584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 143/291] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:15 2022] PUT /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0/users/83c6418715b74c918345cd9d2b78ba79/roles/9eb4e632f5fd40cfa2d008c4408aa72e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:46:15.981107 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.982990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.094897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:16.106862 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 149/292] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:16.112745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:16.226136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6792d7-2464-4b26-b077-773ce617668f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:16.262296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfeac-f92c-4e06-a55b-bc5fb97e6bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:16.262939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfeac-f92c-4e06-a55b-bc5fb97e6bdb None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:16.263250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfeac-f92c-4e06-a55b-bc5fb97e6bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:16.263527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfeac-f92c-4e06-a55b-bc5fb97e6bdb None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:16.264671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfeac-f92c-4e06-a55b-bc5fb97e6bdb None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:16.266106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfeac-f92c-4e06-a55b-bc5fb97e6bdb None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.268084 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 144/293] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:16 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:16.274047 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:16.386653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f395-1ac6-409f-8110-23391239e606 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:16.434441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8190516-bc39-4722-b505-de670ae1416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:16.435070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8190516-bc39-4722-b505-de670ae1416a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:16.435384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8190516-bc39-4722-b505-de670ae1416a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:16.435662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8190516-bc39-4722-b505-de670ae1416a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:16.436399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8190516-bc39-4722-b505-de670ae1416a None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=32e39c90a1c74320a7554fd1010b44a3) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:16.436712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8190516-bc39-4722-b505-de670ae1416a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:16.438159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8190516-bc39-4722-b505-de670ae1416a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.445001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 150/294] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:16 2022] GET /identity/v3/role_assignments?user.id=32e39c90a1c74320a7554fd1010b44a3&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:17.067673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91169-5958-4845-8d9b-b883a36b2817 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.068200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91169-5958-4845-8d9b-b883a36b2817 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.068200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91169-5958-4845-8d9b-b883a36b2817 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.069833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 145/295] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:17.079586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97876-2ab8-4694-a8be-068ad2b88235 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.080061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97876-2ab8-4694-a8be-068ad2b88235 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.080164 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97876-2ab8-4694-a8be-068ad2b88235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.104497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3ba97876-2ab8-4694-a8be-068ad2b88235 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:17.105709 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3ba97876-2ab8-4694-a8be-068ad2b88235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:17.158334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63a21-5bbc-46fd-8ca5-41523263cc73 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.158636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63a21-5bbc-46fd-8ca5-41523263cc73 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.158889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63a21-5bbc-46fd-8ca5-41523263cc73 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.160284 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 146/296] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:17.165628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99f48-e5e3-4bd7-a1f8-5ceb767c7f9a None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.166174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99f48-e5e3-4bd7-a1f8-5ceb767c7f9a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.166642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99f48-e5e3-4bd7-a1f8-5ceb767c7f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.166762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:17.187369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 151/297] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:17.190169 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-47f99f48-e5e3-4bd7-a1f8-5ceb767c7f9a None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:17.191403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-47f99f48-e5e3-4bd7-a1f8-5ceb767c7f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:17.224244 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:17.264586 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 147/298] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:17.482672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97876-2ab8-4694-a8be-068ad2b88235 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:17.539072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99f48-e5e3-4bd7-a1f8-5ceb767c7f9a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:17.601781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97876-2ab8-4694-a8be-068ad2b88235 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:17.639429 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200ad6-e11d-42f1-9dff-8467d8e55552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:17.640435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200ad6-e11d-42f1-9dff-8467d8e55552 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.640930 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200ad6-e11d-42f1-9dff-8467d8e55552 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.641282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200ad6-e11d-42f1-9dff-8467d8e55552 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.655019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64200ad6-e11d-42f1-9dff-8467d8e55552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:17.656397 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99f48-e5e3-4bd7-a1f8-5ceb767c7f9a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-64200ad6-e11d-42f1-9dff-8467d8e55552 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:17.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:17.661436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:17.662800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 152/299] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:17.663505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a6409-409c-4212-8a5a-466e81b77dbe None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.663505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a6409-409c-4212-8a5a-466e81b77dbe None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.671907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a6409-409c-4212-8a5a-466e81b77dbe None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.671907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 153/300] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:17.671907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a6409-409c-4212-8a5a-466e81b77dbe None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:17.700883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445651-7bee-43ae-a7e6-da2de08b466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:17.701535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445651-7bee-43ae-a7e6-da2de08b466f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.701809 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445651-7bee-43ae-a7e6-da2de08b466f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.702078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445651-7bee-43ae-a7e6-da2de08b466f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.703234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445651-7bee-43ae-a7e6-da2de08b466f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:17.704669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445651-7bee-43ae-a7e6-da2de08b466f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:17.710672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 148/301] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:17.710672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386133e-cab8-47c5-851c-366503d9908a None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.710672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386133e-cab8-47c5-851c-366503d9908a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.710672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386133e-cab8-47c5-851c-366503d9908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.726817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-6386133e-cab8-47c5-851c-366503d9908a None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:17.728891 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6386133e-cab8-47c5-851c-366503d9908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:17.729876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:17.764998 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:17.792702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a6409-409c-4212-8a5a-466e81b77dbe None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:17.806250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 149/302] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:17.807266 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386133e-cab8-47c5-851c-366503d9908a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:17.835694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:17.837621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.838196 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.838708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.839773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:17.840328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:17.842009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:17.853578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 154/303] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:17.858715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:17.936412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386133e-cab8-47c5-851c-366503d9908a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:17.988051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:17.988826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.989109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.989392 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] PATH_INFO: `/v3/groups` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.990036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:17.991429 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ade5fb-50b8-4297-b613-6bbc989ecf1f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:17.991626 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.002083 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.028960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.029600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.029903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.030152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] PATH_INFO: `/v3/users/18de7e7de0db41c0942905524f2ca3eb` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.123027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 150/304] 10.222.0.58 () {60 vars in 1134 bytes} [Sun Aug 28 00:46:17 2022] POST /identity/v3/groups => generated 229 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:18.132249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.192491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] RBAC: Authorizing `identity:get_user(user_id=18de7e7de0db41c0942905524f2ca3eb)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.197138 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.201940 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 155/305] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:17 2022] GET /identity/v3/users/18de7e7de0db41c0942905524f2ca3eb => generated 293 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:18.211213 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.221658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.337421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845fdca-d9d6-4149-b7c5-b484c284e2e2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.373169 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34af9b-959f-41ac-810a-b7e3c5e5f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.373835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34af9b-959f-41ac-810a-b7e3c5e5f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.374109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34af9b-959f-41ac-810a-b7e3c5e5f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.374385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34af9b-959f-41ac-810a-b7e3c5e5f1f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.374606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8dda-69f0-4c0c-b0a1-82d13216076f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.385254 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34af9b-959f-41ac-810a-b7e3c5e5f1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-bb34af9b-959f-41ac-810a-b7e3c5e5f1f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:18.390616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:18.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:18.392801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 151/306] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:18.393635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc96a6-16bb-41d8-b786-daa007e3c206 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.393635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc96a6-16bb-41d8-b786-daa007e3c206 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.393635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc96a6-16bb-41d8-b786-daa007e3c206 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.395402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 152/307] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:18.397593 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc96a6-16bb-41d8-b786-daa007e3c206 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.424234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b03194-3bf9-4f80-9d18-fac5429728fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.424850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03194-3bf9-4f80-9d18-fac5429728fc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.425130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03194-3bf9-4f80-9d18-fac5429728fc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.425413 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03194-3bf9-4f80-9d18-fac5429728fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.426124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b03194-3bf9-4f80-9d18-fac5429728fc None admin] RBAC: Adding query filter params (role.id=9eb4e632f5fd40cfa2d008c4408aa72e, user.id=18de7e7de0db41c0942905524f2ca3eb, scope.system=all) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:18.426432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b03194-3bf9-4f80-9d18-fac5429728fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.427911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b03194-3bf9-4f80-9d18-fac5429728fc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.433869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 156/308] 10.222.0.58 () {56 vars in 1308 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/role_assignments?user.id=18de7e7de0db41c0942905524f2ca3eb&scope.system=all&role.id=9eb4e632f5fd40cfa2d008c4408aa72e => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:18.435041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f246d-55b2-4e2d-9c71-6459eae86b2d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.435411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f246d-55b2-4e2d-9c71-6459eae86b2d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.435624 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f246d-55b2-4e2d-9c71-6459eae86b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.460045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3f0f246d-55b2-4e2d-9c71-6459eae86b2d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:18.462009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3f0f246d-55b2-4e2d-9c71-6459eae86b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:18.491466 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.513423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.532766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc96a6-16bb-41d8-b786-daa007e3c206 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.559729 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 157/309] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:18.577931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.578874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.579404 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.579857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.580786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:18.581302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.582889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.593504 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 153/310] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:18.599034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f246d-55b2-4e2d-9c71-6459eae86b2d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.709518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f246d-55b2-4e2d-9c71-6459eae86b2d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.745554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.746201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.746531 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.746809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] PATH_INFO: `/v3/users/fde0507eb57a40a39046ca01ced4613f` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.748125 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] RBAC: Authorizing `identity:get_user(user_id=fde0507eb57a40a39046ca01ced4613f)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.749594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.751536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 158/311] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/users/fde0507eb57a40a39046ca01ced4613f => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:18.757313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.851785 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.870650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273aef9-5601-4296-aea4-ae53bac5acad None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.886038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.906809 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.907493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.907774 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.908047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] PATH_INFO: `/v3/system/users/fde0507eb57a40a39046ca01ced4613f/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.909480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fde0507eb57a40a39046ca01ced4613f, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.910852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.959795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07e0d-26a5-4c99-bb73-bde004d38205 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.995779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.996446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.996749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.997023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.007439 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:19.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:19.013354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:19.014407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 159/312] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:19.019166 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.026466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 154/313] 10.222.0.58 () {58 vars in 1334 bytes} [Sun Aug 28 00:46:18 2022] PUT /identity/v3/system/users/fde0507eb57a40a39046ca01ced4613f/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:19.137456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.155501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb96dd-6db2-4eaf-9403-097ecbcb8c37 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.195279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.196128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.196375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.196617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.197101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:19.197404 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.198794 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.208093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 160/314] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:19.213958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.230982 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.322794 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645cc27-f864-4166-965c-5d30bda770e7 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.364460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.365587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.366583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] PATH_INFO: `/v3/users/83c6418715b74c918345cd9d2b78ba79` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.368600 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] RBAC: Authorizing `identity:get_user(user_id=83c6418715b74c918345cd9d2b78ba79)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.370445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.372926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 155/315] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/users/83c6418715b74c918345cd9d2b78ba79 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:19.383692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.489948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079408b3-f4a6-4961-ab37-58b26c897dad None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.529303 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.529930 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.530213 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.530490 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.606458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.607954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.715800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 161/316] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:19.721670 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.813516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.834793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576dfa-b856-4bfc-9949-7f540c99f7ea None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.873124 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a0fdb-e47b-413e-b687-aee7be0eca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.873761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a0fdb-e47b-413e-b687-aee7be0eca85 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.874041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a0fdb-e47b-413e-b687-aee7be0eca85 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.874318 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a0fdb-e47b-413e-b687-aee7be0eca85 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.875591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a0fdb-e47b-413e-b687-aee7be0eca85 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.877036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a0fdb-e47b-413e-b687-aee7be0eca85 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.879090 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 156/317] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:19.885075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.943649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.997173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05673271-4321-4cae-a24d-8d817b581604 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.032937 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32b122-7e80-4991-8c3a-52b06d125163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.033577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32b122-7e80-4991-8c3a-52b06d125163 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.033854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32b122-7e80-4991-8c3a-52b06d125163 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.034124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32b122-7e80-4991-8c3a-52b06d125163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.034853 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32b122-7e80-4991-8c3a-52b06d125163 None admin] RBAC: Adding query filter params (role.id=9eb4e632f5fd40cfa2d008c4408aa72e, scope.project.id=2f1e914fe128421190cf9ad952d634c0, user.id=83c6418715b74c918345cd9d2b78ba79) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:20.035176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32b122-7e80-4991-8c3a-52b06d125163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:20.036662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32b122-7e80-4991-8c3a-52b06d125163 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:20.043283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 162/318] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/role_assignments?user.id=83c6418715b74c918345cd9d2b78ba79&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=9eb4e632f5fd40cfa2d008c4408aa72e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:20.235523 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1ef8-89c0-44cf-87e5-0a83e37bbe72 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.236000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1ef8-89c0-44cf-87e5-0a83e37bbe72 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.236000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1ef8-89c0-44cf-87e5-0a83e37bbe72 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.237635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 157/319] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:20.243948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0276ee-5244-4e05-ae87-0eb449c0ba82 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.244443 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0276ee-5244-4e05-ae87-0eb449c0ba82 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.244532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0276ee-5244-4e05-ae87-0eb449c0ba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.264066 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-6a0276ee-5244-4e05-ae87-0eb449c0ba82 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:20.265257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6a0276ee-5244-4e05-ae87-0eb449c0ba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:20.335457 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 163/320] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:20.460559 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748744-ed2c-4323-90ba-116cb1c588e2 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.460915 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748744-ed2c-4323-90ba-116cb1c588e2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.461097 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748744-ed2c-4323-90ba-116cb1c588e2 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.462641 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 158/321] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:20.467761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6d70-0119-4b65-a7ad-b96ad970f76c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.468313 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6d70-0119-4b65-a7ad-b96ad970f76c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.468583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd6d70-0119-4b65-a7ad-b96ad970f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.488459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-9efd6d70-0119-4b65-a7ad-b96ad970f76c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:20.489565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-9efd6d70-0119-4b65-a7ad-b96ad970f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:20.525506 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:20.558306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 164/322] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:20.610092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748744-ed2c-4323-90ba-116cb1c588e2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.722577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748744-ed2c-4323-90ba-116cb1c588e2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.756539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.757090 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.757367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.757636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.758763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:20.760229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:20.761943 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 159/323] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:20.767296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd6d70-0119-4b65-a7ad-b96ad970f76c None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.825979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.845308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:20.872505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd6d70-0119-4b65-a7ad-b96ad970f76c None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.912189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9f65-bd0a-4aea-91bf-768e17c93270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.912804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9f65-bd0a-4aea-91bf-768e17c93270 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.913081 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9f65-bd0a-4aea-91bf-768e17c93270 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.913351 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9f65-bd0a-4aea-91bf-768e17c93270 None admin] PATH_INFO: `/v3/groups` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.913989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9f65-bd0a-4aea-91bf-768e17c93270 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:20.915997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9f65-bd0a-4aea-91bf-768e17c93270 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:20.941089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede9156-a413-43ab-8ebb-193870863f19 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.974391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.975018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.975325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.975596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.986146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:20.991460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:20.993142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:20.993975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 160/324] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:20.998956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.012282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 165/325] 10.222.0.58 () {60 vars in 1134 bytes} [Sun Aug 28 00:46:20 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:21.087025 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.113133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09a7a-be75-4a8d-9f31-0b406f615c83 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.122332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94465-f36d-4b9b-9501-97c55909a94f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.122682 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94465-f36d-4b9b-9501-97c55909a94f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.122900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94465-f36d-4b9b-9501-97c55909a94f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.124701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 166/326] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:21.130001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc58e0-7454-490e-9493-cdc0f3589916 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.130291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc58e0-7454-490e-9493-cdc0f3589916 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.130547 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc58e0-7454-490e-9493-cdc0f3589916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.149876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3abc58e0-7454-490e-9493-cdc0f3589916 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:21.151149 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3abc58e0-7454-490e-9493-cdc0f3589916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:21.155585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.156209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.156491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.156768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.157476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:21.157786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.159242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.171382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 161/327] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:21.178182 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.181691 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.235826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 167/328] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:46:21.301579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775afd26-cf58-4794-8c60-b08d4d39648a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.339226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.340137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.340625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.341038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] PATH_INFO: `/v3/users/18de7e7de0db41c0942905524f2ca3eb` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.342384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] RBAC: Authorizing `identity:get_user(user_id=18de7e7de0db41c0942905524f2ca3eb)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.344311 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.346381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 162/329] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/users/18de7e7de0db41c0942905524f2ca3eb => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:21.351906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc58e0-7454-490e-9493-cdc0f3589916 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.463947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc58e0-7454-490e-9493-cdc0f3589916 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.507662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.518687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.519994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.521356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.521645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.521924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] PATH_INFO: `/v3/system/users/18de7e7de0db41c0942905524f2ca3eb/roles/9eb4e632f5fd40cfa2d008c4408aa72e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.525937 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=18de7e7de0db41c0942905524f2ca3eb, role_id=9eb4e632f5fd40cfa2d008c4408aa72e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.527367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.617225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 168/330] 10.222.0.58 () {58 vars in 1334 bytes} [Sun Aug 28 00:46:21 2022] PUT /identity/v3/system/users/18de7e7de0db41c0942905524f2ca3eb/roles/9eb4e632f5fd40cfa2d008c4408aa72e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:46:21.627836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdaee6-3280-444c-9074-05fae586e461 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.676165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.676165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.676165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.676165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.689534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:21.697356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:21.698340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:21.699173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:21.701741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 163/331] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:21.707410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.758219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.862322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84112dae-5afe-4bc0-bdb4-d4c75fe632d3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.905850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.906395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.906674 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.906945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.907713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:21.908015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.909429 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.919227 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 169/332] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:21.924886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:22.037396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:22.083585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f817a2-10dd-4050-9095-09f3eae346d3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:22.151901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a59110-d920-4371-b225-047f748b2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:22.152569 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59110-d920-4371-b225-047f748b2e52 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:22.160712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59110-d920-4371-b225-047f748b2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:22.161243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59110-d920-4371-b225-047f748b2e52 None admin] PATH_INFO: `/v3/users/fde0507eb57a40a39046ca01ced4613f` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:22.163148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a59110-d920-4371-b225-047f748b2e52 None admin] RBAC: Authorizing `identity:get_user(user_id=fde0507eb57a40a39046ca01ced4613f)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:22.164664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a59110-d920-4371-b225-047f748b2e52 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:22.166937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 164/333] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/users/fde0507eb57a40a39046ca01ced4613f => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:22.178681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:22.301816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:22.317333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ace343-eefc-4c58-9d10-888be932c0f9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:22.359782 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89e543-c4cd-46f1-98c8-1971da7faff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:22.363183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e543-c4cd-46f1-98c8-1971da7faff0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:22.363183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e543-c4cd-46f1-98c8-1971da7faff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:22.363183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e543-c4cd-46f1-98c8-1971da7faff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:22.363183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89e543-c4cd-46f1-98c8-1971da7faff0 None admin] RBAC: Adding query filter params (role.id=70eb8f7fc9b340d3a20422a2225491fd, user.id=fde0507eb57a40a39046ca01ced4613f, scope.system=all) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:22.363183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89e543-c4cd-46f1-98c8-1971da7faff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:22.363616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89e543-c4cd-46f1-98c8-1971da7faff0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:22.377956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 170/334] 10.222.0.58 () {56 vars in 1308 bytes} [Sun Aug 28 00:46:22 2022] GET /identity/v3/role_assignments?user.id=fde0507eb57a40a39046ca01ced4613f&scope.system=all&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:23.908589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5e72-65c6-4dfe-9212-f6e781aaa4f1 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:23.909095 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5e72-65c6-4dfe-9212-f6e781aaa4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:23.909170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5e72-65c6-4dfe-9212-f6e781aaa4f1 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:23.910728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 165/335] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:23.917261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26072e0-1aad-4f9b-b954-89cfe6a732d4 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:23.918229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26072e0-1aad-4f9b-b954-89cfe6a732d4 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:23.918719 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26072e0-1aad-4f9b-b954-89cfe6a732d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:23.943482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-a26072e0-1aad-4f9b-b954-89cfe6a732d4 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:23.945163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-a26072e0-1aad-4f9b-b954-89cfe6a732d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:24.032169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 171/336] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:24.066273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8f8e-0624-4090-9fc6-28276e10b54c None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.066894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8f8e-0624-4090-9fc6-28276e10b54c None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.067395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8f8e-0624-4090-9fc6-28276e10b54c None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.068942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 166/337] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:24.075752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278f53-6ece-4ebd-b235-e049d738d4bb None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.076362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278f53-6ece-4ebd-b235-e049d738d4bb None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.076876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278f53-6ece-4ebd-b235-e049d738d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.096086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-7a278f53-6ece-4ebd-b235-e049d738d4bb None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:24.097611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-7a278f53-6ece-4ebd-b235-e049d738d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:24.181923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 172/338] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:24.574631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8f8e-0624-4090-9fc6-28276e10b54c None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.721032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8f8e-0624-4090-9fc6-28276e10b54c None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.722403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02576c4-0268-4c0a-a44e-6bcb372ea65b None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.722691 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02576c4-0268-4c0a-a44e-6bcb372ea65b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.722962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02576c4-0268-4c0a-a44e-6bcb372ea65b None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.724344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 173/339] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:24.732411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c7d4-0ec0-404e-9679-77e9bce3f05a None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.732684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c7d4-0ec0-404e-9679-77e9bce3f05a None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.733117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c7d4-0ec0-404e-9679-77e9bce3f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.763827 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.776379 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.777366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.777650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.777930 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.782405 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-eaf0c7d4-0ec0-404e-9679-77e9bce3f05a None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:24.784642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-eaf0c7d4-0ec0-404e-9679-77e9bce3f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:24.795483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.809367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:24.816376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:24.817508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 167/340] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:24.818516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.937279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 174/341] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:24.938784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c7d4-0ec0-404e-9679-77e9bce3f05a None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.978290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c32c47-43a5-4040-8088-22f66669a89d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.021249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bc502-8bac-4a1c-a2d9-804d36e7d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.022189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc502-8bac-4a1c-a2d9-804d36e7d533 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.022822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc502-8bac-4a1c-a2d9-804d36e7d533 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.023382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc502-8bac-4a1c-a2d9-804d36e7d533 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.043701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bc502-8bac-4a1c-a2d9-804d36e7d533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-929bc502-8bac-4a1c-a2d9-804d36e7d533 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:25.050855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:25.051904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:25.052740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:25.055283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 168/342] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:25.057113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292430-6bd9-41fb-b96b-ad9ad9c8d191 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.057541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292430-6bd9-41fb-b96b-ad9ad9c8d191 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.058119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6292430-6bd9-41fb-b96b-ad9ad9c8d191 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.060568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 169/343] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:25.061718 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6292430-6bd9-41fb-b96b-ad9ad9c8d191 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.093202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c7d4-0ec0-404e-9679-77e9bce3f05a None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.153301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.155792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05224fd-2a1b-405b-9b38-cf58ddcf0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.156559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05224fd-2a1b-405b-9b38-cf58ddcf0fae None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.156685 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05224fd-2a1b-405b-9b38-cf58ddcf0fae None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.156958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05224fd-2a1b-405b-9b38-cf58ddcf0fae None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.157647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05224fd-2a1b-405b-9b38-cf58ddcf0fae None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:25.157956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05224fd-2a1b-405b-9b38-cf58ddcf0fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.160329 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05224fd-2a1b-405b-9b38-cf58ddcf0fae None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.164399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.172385 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 175/344] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:25.174115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408286ac-a18a-4376-bad2-a211663fdeed None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.174582 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408286ac-a18a-4376-bad2-a211663fdeed None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.175026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408286ac-a18a-4376-bad2-a211663fdeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.200282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-408286ac-a18a-4376-bad2-a211663fdeed None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:25.200282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-408286ac-a18a-4376-bad2-a211663fdeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:25.225906 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6292430-6bd9-41fb-b96b-ad9ad9c8d191 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.267652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.268275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.268556 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.268826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.269510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:25.269820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.271276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.281821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 170/345] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:25.282684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.302693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:25.306507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408286ac-a18a-4376-bad2-a211663fdeed None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.410696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888336e-c72a-41c1-a4f3-1dce7c335f93 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.430826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.450570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf55968-3cca-43c7-8e33-6f4ab428e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.451214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55968-3cca-43c7-8e33-6f4ab428e18d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.451654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55968-3cca-43c7-8e33-6f4ab428e18d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.451937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55968-3cca-43c7-8e33-6f4ab428e18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.455372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408286ac-a18a-4376-bad2-a211663fdeed None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.491535 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.501431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc14e-2435-46da-a423-b35b11b8033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.503133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc14e-2435-46da-a423-b35b11b8033b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.503893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc14e-2435-46da-a423-b35b11b8033b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.504871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc14e-2435-46da-a423-b35b11b8033b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.534986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf55968-3cca-43c7-8e33-6f4ab428e18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.536519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf55968-3cca-43c7-8e33-6f4ab428e18d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.591886 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc14e-2435-46da-a423-b35b11b8033b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.594115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc14e-2435-46da-a423-b35b11b8033b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.660654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 171/347] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:25.662799 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d52ce-6af9-411e-821e-cc8ac7fa52b4 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.667402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d52ce-6af9-411e-821e-cc8ac7fa52b4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.667780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d52ce-6af9-411e-821e-cc8ac7fa52b4 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.670456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 172/348] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:25.670456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d52ce-6af9-411e-821e-cc8ac7fa52b4 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.692148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.729831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 177/349] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:25.731397 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603cbb-3c35-49e9-81b9-9f6e29273379 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.731737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603cbb-3c35-49e9-81b9-9f6e29273379 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.732017 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603cbb-3c35-49e9-81b9-9f6e29273379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.750815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-85603cbb-3c35-49e9-81b9-9f6e29273379 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:25.752053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-85603cbb-3c35-49e9-81b9-9f6e29273379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:25.780095 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.816428 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d52ce-6af9-411e-821e-cc8ac7fa52b4 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.841306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 178/350] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:25.842046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603cbb-3c35-49e9-81b9-9f6e29273379 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.874767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1848d3-48ca-4d61-8f89-ffc16cbfb1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.875432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1848d3-48ca-4d61-8f89-ffc16cbfb1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.875708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1848d3-48ca-4d61-8f89-ffc16cbfb1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.876032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1848d3-48ca-4d61-8f89-ffc16cbfb1d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.892219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1848d3-48ca-4d61-8f89-ffc16cbfb1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-af1848d3-48ca-4d61-8f89-ffc16cbfb1d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:25.897757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:25.899458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:25.900637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 173/351] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:25.901336 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c555e-1dfa-408e-964c-cdcdd9ceca8d None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.901336 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c555e-1dfa-408e-964c-cdcdd9ceca8d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.901584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c555e-1dfa-408e-964c-cdcdd9ceca8d None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.904830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 174/352] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:25.905881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c555e-1dfa-408e-964c-cdcdd9ceca8d None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.982957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603cbb-3c35-49e9-81b9-9f6e29273379 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.011582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.028996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.029585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.029849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.030124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.031707 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.034720 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.035521 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 179/353] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:26.042063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.043837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c555e-1dfa-408e-964c-cdcdd9ceca8d None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.076111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.090607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.091922 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.095670 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.095670 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.106487 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:26.111649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:26.112599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:26.113396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 175/354] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:26.114083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.176461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d002ea5-a48e-4b74-ae0c-84c7c843fa08 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.220338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da54a3-31a4-4847-93d4-98c163fca18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.220977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da54a3-31a4-4847-93d4-98c163fca18b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.221373 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da54a3-31a4-4847-93d4-98c163fca18b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.221594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da54a3-31a4-4847-93d4-98c163fca18b None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.222729 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da54a3-31a4-4847-93d4-98c163fca18b None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.224194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da54a3-31a4-4847-93d4-98c163fca18b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.227561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 180/355] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:26.228926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2b6a7-965f-4662-a89f-36854812fb46 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.229206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2b6a7-965f-4662-a89f-36854812fb46 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.229479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2b6a7-965f-4662-a89f-36854812fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.233290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270646-d7ac-48bb-8f73-e22988d7be94 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.248719 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-33f2b6a7-965f-4662-a89f-36854812fb46 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:26.249910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-33f2b6a7-965f-4662-a89f-36854812fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:26.276975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.277752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.278028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.279036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.279454 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:26.279876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.281448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.284051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.290903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 176/356] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:26.291774 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.331586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 181/357] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:26.332856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2b6a7-965f-4662-a89f-36854812fb46 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.365718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.436369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c51daf-d3b3-442d-b6dd-ebab6f5f411b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.458950 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2b6a7-965f-4662-a89f-36854812fb46 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.483810 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.484563 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.485430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.485711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.497096 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.498815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.500524 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 177/358] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:26.501285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.513724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.514353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.514689 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.514964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.515716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:26.516017 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.517407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.528170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 182/359] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:26.529126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.598633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.659561 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608f148-a777-46b0-b81a-80d15a3500cd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.679353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.705959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.706638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.706885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.707249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.710307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912db6f-ca33-4f26-8056-42dadc6e0f81 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.732742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:26.740353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:26.741380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:26.742211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:26.747985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 178/360] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:26.747985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.766896 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.767996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.768455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.768815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.770949 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.771779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.773989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 183/361] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:26.775019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:26.889790 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca225c-f172-4150-91c7-d037f9153c62 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.924397 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.939149 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26c57f-9172-4598-a628-65e63629a535 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.943288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.945288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.945288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.945288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] PATH_INFO: `/v3/users/18de7e7de0db41c0942905524f2ca3eb` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.947005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] RBAC: Authorizing `identity:get_user(user_id=18de7e7de0db41c0942905524f2ca3eb)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.948540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.957362 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 179/362] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/users/18de7e7de0db41c0942905524f2ca3eb => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:26.957362 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.000916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.001554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.001788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.003151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.005488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:27.005488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:27.008384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:27.020528 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 184/363] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:27.021039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.050104 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:27.110569 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3a64-c306-447b-bbd0-515366a1e05e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.169120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.170004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.170444 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.170716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.174250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde193-6a41-4cff-811b-6f41f7a20afa None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.221022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.221022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.221022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.221022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.233628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:27.239136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:27.240080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:27.240889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 185/364] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:27.241539 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.269438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:27.287758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:27.290356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:27.355751 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:27.379091 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c8711-269a-4e4f-970c-52c4f208002f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.417474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 180/365] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:27.417474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.422316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.422944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.423276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.423555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.424236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:27.424540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:27.425938 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:27.435193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 186/366] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:27.440679 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.518453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:27.531457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54dde-bc6e-475b-8766-ed4c677eef49 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.556507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1868c0d-dc81-4efe-a9ae-237c744e8d2d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.574055 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.574667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.574940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.575253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.575984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:27.576288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:27.577727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:27.591150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 181/367] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:27.591150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.606852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.607534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.607813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.608105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.608826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] RBAC: Adding query filter params (role.id=9eb4e632f5fd40cfa2d008c4408aa72e, user.id=18de7e7de0db41c0942905524f2ca3eb, scope.system=all) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:27.609837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:27.611742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:27.622451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:27.635283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 187/368] 10.222.0.58 () {56 vars in 1308 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/role_assignments?user.id=18de7e7de0db41c0942905524f2ca3eb&scope.system=all&role.id=9eb4e632f5fd40cfa2d008c4408aa72e => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:27.636247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.770231 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536e475-a350-4e48-b41d-6448195ba28e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.813930 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.815006 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.815553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.816037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.817038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:27.817548 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:27.819336 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:27.821593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b98fa-140b-4e9b-bf16-ae680c5cbe08 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.830793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 182/369] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:27.832044 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.855320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:27.873809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:27.874456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.874730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.874999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.876191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:27.877627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:27.879470 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 188/370] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:27.880073 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:27.952649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:27.957977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c609ab7-7ae9-4953-989f-fda43de1dbfa None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:27.991576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c92d2f-9071-4a55-b624-6f12dee8ad53 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.002041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.003059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.003690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.004171 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.033268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.033953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.034159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.034449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.087352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.089381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.110791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.111430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.112229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.183141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.210626 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 183/371] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:28.216056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.221240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 189/372] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:28.225981 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.332420 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a87a0-7ab0-4b83-ac72-65e24bf749cc None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.342442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ada6-b3d8-496f-b9e8-843419df40db None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.367764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.375201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.383507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.383507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.383507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.383507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.383831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.383831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.383831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.384046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.384113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.384113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.384251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 184/373] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.384251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.384450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.386517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 190/374] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.392469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.436342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.515905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5c3a2-f035-46df-ad4d-9d57ada3e3d8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.526388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52412d-9f24-4df6-bc75-7d1484927074 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.561777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.562389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.562662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.562934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.563708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=2f1e914fe128421190cf9ad952d634c0) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:28.564014 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.565460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.572233 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 191/375] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.572913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.574303 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.575054 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.575446 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.576065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] PATH_INFO: `/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.578394 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] RBAC: Authorizing `identity:get_project(project_id=b4a5e2ed24234c04bb44f2eb019170b1)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.579946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.582059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 185/376] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.593756 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.699555 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.741474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d1a7e-af4e-4872-8ed8-6379a7ccbc1b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.783546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.784202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.784481 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.784778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] PATH_INFO: `/v3/groups/96b268c5814e4970817ced44764a5e48` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.788169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.792325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] RBAC: Authorizing `identity:get_group(group_id=96b268c5814e4970817ced44764a5e48)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.793315 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2d0d9-f62c-4e49-a1db-efba7ade6ed5 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.793789 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.795797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 186/377] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/groups/96b268c5814e4970817ced44764a5e48 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.805711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.847364 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.848328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.848820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.849286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.852174 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.854198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.856213 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 192/378] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.868413 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.935122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26050f-a971-4032-ba5c-fc51ae8c793a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.955896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:29.003862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d22028-12bd-45c7-812d-bf60d10c3ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.004855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22028-12bd-45c7-812d-bf60d10c3ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.005331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22028-12bd-45c7-812d-bf60d10c3ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.005832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d22028-12bd-45c7-812d-bf60d10c3ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.006765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22028-12bd-45c7-812d-bf60d10c3ce8 None admin] RBAC: Adding query filter params (group.id=96b268c5814e4970817ced44764a5e48, role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=b4a5e2ed24234c04bb44f2eb019170b1) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:29.007294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22028-12bd-45c7-812d-bf60d10c3ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.009691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d22028-12bd-45c7-812d-bf60d10c3ce8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.021358 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 187/379] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/role_assignments?group.id=96b268c5814e4970817ced44764a5e48&scope.project.id=b4a5e2ed24234c04bb44f2eb019170b1&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:29.044032 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b03d2-6fa6-457a-8b80-b39f4cbd24a8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.086958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e2da7-a6d7-4c24-a1d3-b8b24ec12a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.087629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e2da7-a6d7-4c24-a1d3-b8b24ec12a80 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.087962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e2da7-a6d7-4c24-a1d3-b8b24ec12a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.088232 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e2da7-a6d7-4c24-a1d3-b8b24ec12a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.089031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e2da7-a6d7-4c24-a1d3-b8b24ec12a80 None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=2f1e914fe128421190cf9ad952d634c0) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:29.089345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e2da7-a6d7-4c24-a1d3-b8b24ec12a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.090834 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e2da7-a6d7-4c24-a1d3-b8b24ec12a80 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.098167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 193/380] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:29.255942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52270-e35a-4c55-90c1-537abc81f605 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.256453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52270-e35a-4c55-90c1-537abc81f605 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.256714 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52270-e35a-4c55-90c1-537abc81f605 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.259195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 188/381] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:29.264947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeef5e5-a6fb-4323-9761-840a0f99229d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.265262 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeef5e5-a6fb-4323-9761-840a0f99229d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.265505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeef5e5-a6fb-4323-9761-840a0f99229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.287201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-dbeef5e5-a6fb-4323-9761-840a0f99229d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:29.288411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-dbeef5e5-a6fb-4323-9761-840a0f99229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:29.315244 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:29.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 194/382] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:29.641829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c52270-e35a-4c55-90c1-537abc81f605 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:29.772089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c52270-e35a-4c55-90c1-537abc81f605 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.808687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.809325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.809601 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.809875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.820680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:29.826224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:29.827119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:29.827916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 189/383] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:29.834876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeef5e5-a6fb-4323-9761-840a0f99229d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:29.961836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeef5e5-a6fb-4323-9761-840a0f99229d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.997462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.998072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.998348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.998618 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.999313 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:29.999617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.001056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.010552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 195/384] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:30.016109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.061609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:30.145275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162f49-f79c-42d8-a343-f3270472479e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ca83-26e0-4f41-96bb-2f7e53363cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.189499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ca83-26e0-4f41-96bb-2f7e53363cfd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.189776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ca83-26e0-4f41-96bb-2f7e53363cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.190046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ca83-26e0-4f41-96bb-2f7e53363cfd None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.191201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ca83-26e0-4f41-96bb-2f7e53363cfd None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.192708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ca83-26e0-4f41-96bb-2f7e53363cfd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.194273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 190/385] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:30 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:30.200461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.229359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:30.253295 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ac1f-875b-486d-a84a-adfd11ce813d None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.253602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ac1f-875b-486d-a84a-adfd11ce813d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.253850 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ac1f-875b-486d-a84a-adfd11ce813d None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.255560 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 191/386] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:30.260723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d95ef-adc9-4536-b3f3-2745a48c7b5e None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.261276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d95ef-adc9-4536-b3f3-2745a48c7b5e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.261375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d95ef-adc9-4536-b3f3-2745a48c7b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.291773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-073d95ef-adc9-4536-b3f3-2745a48c7b5e None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:30.292974 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-073d95ef-adc9-4536-b3f3-2745a48c7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:30.318142 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede580b7-f3b6-4b85-a0e1-0a8d1f0abaf9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.366522 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.368569 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.369450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.370492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.373269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.376989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.386129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 196/387] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:30 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:30.392183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.447928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 192/388] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:30.527354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0ed8-12b1-4858-bf40-f29462e4e7e8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.535567 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:30.564308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.565354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.565860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.566391 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/groups/6d1caf025beb4af48dc42d8d031320b7/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.568930 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] RBAC: Authorizing `identity:create_grant(project_id=71ff6b9731cb4eae9ad324df59928ed5, group_id=6d1caf025beb4af48dc42d8d031320b7, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.571252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.654176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 197/389] 10.222.0.58 () {58 vars in 1442 bytes} [Sun Aug 28 00:46:30 2022] PUT /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/groups/6d1caf025beb4af48dc42d8d031320b7/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:30.800209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d95ef-adc9-4536-b3f3-2745a48c7b5e None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.850787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:30.934173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d95ef-adc9-4536-b3f3-2745a48c7b5e None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.979980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d42d7-02d3-492d-86be-ed7b7cfb8765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.980660 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d42d7-02d3-492d-86be-ed7b7cfb8765 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.981016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d42d7-02d3-492d-86be-ed7b7cfb8765 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.981292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d42d7-02d3-492d-86be-ed7b7cfb8765 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.997353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d42d7-02d3-492d-86be-ed7b7cfb8765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-632d42d7-02d3-492d-86be-ed7b7cfb8765 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:31.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:31.003380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:31.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 193/390] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:31.010099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.147331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246ea0-76cf-4b49-87d3-d366a07dd1ad None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.147620 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246ea0-76cf-4b49-87d3-d366a07dd1ad None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.147816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5246ea0-76cf-4b49-87d3-d366a07dd1ad None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.150140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 194/391] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:31.155947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdc65-36a1-415a-b8e0-697e2982dddb None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.156354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdc65-36a1-415a-b8e0-697e2982dddb None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.156933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdc65-36a1-415a-b8e0-697e2982dddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.160547 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf630-3786-49ad-8f68-a9cb4c97f460 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:31.180289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-1bfcdc65-36a1-415a-b8e0-697e2982dddb None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:31.181748 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-1bfcdc65-36a1-415a-b8e0-697e2982dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:31.238433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecb30c-b35e-4494-9523-86533d32b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:31.239057 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecb30c-b35e-4494-9523-86533d32b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.239367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecb30c-b35e-4494-9523-86533d32b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.239640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecb30c-b35e-4494-9523-86533d32b7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.240328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecb30c-b35e-4494-9523-86533d32b7a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:31.240632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecb30c-b35e-4494-9523-86533d32b7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:31.242616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecb30c-b35e-4494-9523-86533d32b7a7 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:31.262840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 195/392] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:31.265865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 198/393] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:31.271506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcdc65-36a1-415a-b8e0-697e2982dddb None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.307514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:31.319339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3839-8c30-4c38-8273-274ee2012cdd None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.319916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3839-8c30-4c38-8273-274ee2012cdd None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.327070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3839-8c30-4c38-8273-274ee2012cdd None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.327070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 199/394] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:31.328847 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56358349-1d29-4512-913c-81330f5aa36d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.329353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56358349-1d29-4512-913c-81330f5aa36d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.329814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56358349-1d29-4512-913c-81330f5aa36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.352776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-56358349-1d29-4512-913c-81330f5aa36d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:31.354480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-56358349-1d29-4512-913c-81330f5aa36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:31.383997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcdc65-36a1-415a-b8e0-697e2982dddb None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:31.387482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:31.422570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:31.423143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.423425 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.423696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.425161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:31.426502 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:31.428495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 196/395] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:31 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:31.450470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.450927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 200/396] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:31.581127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:31.587772 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b9aa-9d13-4993-a841-528f94247c0f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:31.620741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56358349-1d29-4512-913c-81330f5aa36d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.639921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:31.640570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.640847 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.641118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.643535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:31.645027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:31.652466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 197/397] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:31 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:31.657788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.774779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56358349-1d29-4512-913c-81330f5aa36d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:31.791233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702a82-1b00-40f3-8438-27090524a3fa None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:31.811401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c063e8-4f82-4358-bece-bebf0cb5aded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:31.812033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c063e8-4f82-4358-bece-bebf0cb5aded None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.812374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c063e8-4f82-4358-bece-bebf0cb5aded None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.812570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c063e8-4f82-4358-bece-bebf0cb5aded None admin] PATH_INFO: `/v3/roles/member` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.827926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c063e8-4f82-4358-bece-bebf0cb5aded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:31.832982 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18783d-d8c0-4bef-82ff-efc44deea703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:31.833711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18783d-d8c0-4bef-82ff-efc44deea703 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.834075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18783d-d8c0-4bef-82ff-efc44deea703 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-f5c063e8-4f82-4358-bece-bebf0cb5aded None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:31.834377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:31.835479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:31.837252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:31.837997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18783d-d8c0-4bef-82ff-efc44deea703 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/groups/6d1caf025beb4af48dc42d8d031320b7/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.838959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18783d-d8c0-4bef-82ff-efc44deea703 None admin] RBAC: Authorizing `identity:create_grant(project_id=71ff6b9731cb4eae9ad324df59928ed5, group_id=6d1caf025beb4af48dc42d8d031320b7, role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:31.839455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 201/398] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:31.840721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18783d-d8c0-4bef-82ff-efc44deea703 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:31.840991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6529346-c5c2-44a7-aa93-9b1119359bb9 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.841440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6529346-c5c2-44a7-aa93-9b1119359bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.841900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6529346-c5c2-44a7-aa93-9b1119359bb9 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.844228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 202/399] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:31.846864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6529346-c5c2-44a7-aa93-9b1119359bb9 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.852165 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:31.915135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 198/400] 10.222.0.58 () {58 vars in 1442 bytes} [Sun Aug 28 00:46:31 2022] PUT /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5/groups/6d1caf025beb4af48dc42d8d031320b7/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:31.915135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610411-5ddc-4b71-887c-c8d8ea8ddbc2 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.915135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610411-5ddc-4b71-887c-c8d8ea8ddbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.915135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610411-5ddc-4b71-887c-c8d8ea8ddbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.927757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-87610411-5ddc-4b71-887c-c8d8ea8ddbc2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:31.928977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-87610411-5ddc-4b71-887c-c8d8ea8ddbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:31.949603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:31.984860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6529346-c5c2-44a7-aa93-9b1119359bb9 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.011024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 199/401] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:32.012050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87610411-5ddc-4b71-887c-c8d8ea8ddbc2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.029579 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.030434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.030434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.030707 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.031511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] RBAC: Adding query filter params (name=member) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:32.031814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:32.033398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:32.043808 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 203/402] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:32.049650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.139431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87610411-5ddc-4b71-887c-c8d8ea8ddbc2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.140028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:32.172725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30822c37-e3a0-4bf8-8e06-ec8cae25f24f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.187472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.188125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.188403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.188674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.203174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:32.209764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:32.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:32.211698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:32.215180 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 200/403] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:32.216034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.217101 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.218250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.219113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.219945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.221298 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:32.223000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:32.225133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 204/404] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:32.236500 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.241160 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:32.382275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7490c-2e65-4512-a1e9-de73a05275c6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.400229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95950aee-53fd-40da-9e5e-c046d1c2d9a1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.415346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:32.420572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.421213 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.421496 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.422066 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.422895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:32.424475 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:32.426495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 205/405] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:32.431450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.446986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.447899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.448531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.448976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.450438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:32.450918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:32.454089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:32.466625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 201/406] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:32.467999 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.553140 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f380-1d95-48ee-be3d-1b051e4719c6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.561520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:32.586938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752410cc-1ec5-45f0-b0a0-34f41ce620ab None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.591933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.593063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.593520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.594021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.606571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:32.612576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:32.613484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:32.614280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:32.621389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 206/407] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:32.622536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.623175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.623911 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.624256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.624600 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0/groups/6d1caf025beb4af48dc42d8d031320b7/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.626649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f1e914fe128421190cf9ad952d634c0, group_id=6d1caf025beb4af48dc42d8d031320b7, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:32.628263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:32.698932 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:32.714038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 202/408] 10.222.0.58 () {58 vars in 1442 bytes} [Sun Aug 28 00:46:32 2022] PUT /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0/groups/6d1caf025beb4af48dc42d8d031320b7/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:32.715338 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.751023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813219e-3c7b-4afa-a096-924f867c9f2a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.800129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.801732 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.802318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.803032 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.805855 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:32.808240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:32.809900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 207/409] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:32.815895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.866179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41ee9-ace7-426b-bc7d-349f4e120790 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:32.934384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:32.934924 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:32.935251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:32.935528 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:32.936207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:32.936527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:32.937895 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:32.940394 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:32.949514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 203/410] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:32.955282 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:32.989093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4e4c-2fa0-4c90-9330-b66e5abf7df0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:33.026269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:33.037478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:33.039554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.040449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.040948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.042426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:33.045157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:33.047186 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 208/411] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:33.053356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:33.097057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b5a85-96d8-4d83-bd4e-8e7b05c17e72 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:33.151936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9bb9d-7ba9-4003-a27a-99608368f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:33.153101 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9bb9d-7ba9-4003-a27a-99608368f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.154018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9bb9d-7ba9-4003-a27a-99608368f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.154476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9bb9d-7ba9-4003-a27a-99608368f1d4 None admin] PATH_INFO: `/v3/groups/96b268c5814e4970817ced44764a5e48` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.156101 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9bb9d-7ba9-4003-a27a-99608368f1d4 None admin] RBAC: Authorizing `identity:get_group(group_id=96b268c5814e4970817ced44764a5e48)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:33.158554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9bb9d-7ba9-4003-a27a-99608368f1d4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:33.161298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 204/412] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:32 2022] GET /identity/v3/groups/96b268c5814e4970817ced44764a5e48 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:33.162927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf9b9-fd0c-405a-aee7-33eeacebf2a4 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.163400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf9b9-fd0c-405a-aee7-33eeacebf2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.164708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf9b9-fd0c-405a-aee7-33eeacebf2a4 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.167175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 205/413] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:33.168054 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bf9b9-fd0c-405a-aee7-33eeacebf2a4 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:33.180889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9af52-488d-4c57-8ac8-78432fa89c6e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:33.226885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07dda8-630f-4fcb-a374-0a99171221cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:33.228499 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07dda8-630f-4fcb-a374-0a99171221cf None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.228899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07dda8-630f-4fcb-a374-0a99171221cf None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.229277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07dda8-630f-4fcb-a374-0a99171221cf None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0/groups/6d1caf025beb4af48dc42d8d031320b7/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.232449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07dda8-630f-4fcb-a374-0a99171221cf None admin] RBAC: Authorizing `identity:create_grant(project_id=2f1e914fe128421190cf9ad952d634c0, group_id=6d1caf025beb4af48dc42d8d031320b7, role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:33.234796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07dda8-630f-4fcb-a374-0a99171221cf None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:33.259093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:33.295261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bf9b9-fd0c-405a-aee7-33eeacebf2a4 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:33.305865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 209/414] 10.222.0.58 () {58 vars in 1442 bytes} [Sun Aug 28 00:46:33 2022] PUT /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0/groups/6d1caf025beb4af48dc42d8d031320b7/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:46:33.307733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31bd0-5a2c-4805-b7fd-f9b7bc7cb47d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.308151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31bd0-5a2c-4805-b7fd-f9b7bc7cb47d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.309062 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31bd0-5a2c-4805-b7fd-f9b7bc7cb47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.335491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-03f31bd0-5a2c-4805-b7fd-f9b7bc7cb47d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:33.337449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-03f31bd0-5a2c-4805-b7fd-f9b7bc7cb47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:33.337626 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:33.338650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.339182 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.339660 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] PATH_INFO: `/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.341283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] RBAC: Authorizing `identity:get_project(project_id=b4a5e2ed24234c04bb44f2eb019170b1)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:33.343627 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:33.345642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 206/415] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:33 2022] GET /identity/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:33.350951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:33.413333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:33.429636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 210/416] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:33.532637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f1f63-9ee0-4dc4-bb55-3a40f7b684a3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:33.571849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:33.572517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.572929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.573204 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] PATH_INFO: `/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1/groups/96b268c5814e4970817ced44764a5e48/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4a5e2ed24234c04bb44f2eb019170b1, group_id=96b268c5814e4970817ced44764a5e48, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:33.577047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:33.579659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:33.659832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 207/417] 10.222.0.58 () {58 vars in 1442 bytes} [Sun Aug 28 00:46:33 2022] PUT /identity/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1/groups/96b268c5814e4970817ced44764a5e48/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:46:33.765480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f31bd0-5a2c-4805-b7fd-f9b7bc7cb47d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:33.877194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f31bd0-5a2c-4805-b7fd-f9b7bc7cb47d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:33.912809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:33.913448 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.914263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.914720 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.925477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:33.930900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:33.931837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:33.932662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:33.936339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 211/418] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:33.938231 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.061226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfcfe-d319-45a2-adf5-ee2cf01506e2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.110605 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1866d-1b64-414a-a548-704f8f0358ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.111251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1866d-1b64-414a-a548-704f8f0358ab None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.111525 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1866d-1b64-414a-a548-704f8f0358ab None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.111792 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1866d-1b64-414a-a548-704f8f0358ab None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.112460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1866d-1b64-414a-a548-704f8f0358ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:34.112755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1866d-1b64-414a-a548-704f8f0358ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.114123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1866d-1b64-414a-a548-704f8f0358ab None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.127370 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 208/419] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:34.132879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.203545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.252442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa755a-41b2-4ece-8f6b-a53977d2c10a None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.252783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa755a-41b2-4ece-8f6b-a53977d2c10a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.252978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa755a-41b2-4ece-8f6b-a53977d2c10a None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.254656 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 209/420] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:34.259515 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff676-db94-429e-99d4-0695077eef23 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.259794 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff676-db94-429e-99d4-0695077eef23 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.260070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff676-db94-429e-99d4-0695077eef23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.261165 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2e99-fe33-4587-894b-def94bee3e66 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.296739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-084ff676-db94-429e-99d4-0695077eef23 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:34.297052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.297667 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.297943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.298108 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-084ff676-db94-429e-99d4-0695077eef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:34.298258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.369782 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.371279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.393649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.424856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.433146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 210/421] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:34.489245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 212/422] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:34.490665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff676-db94-429e-99d4-0695077eef23 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.613342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff676-db94-429e-99d4-0695077eef23 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.651509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.652069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.652339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.652603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.653744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.658363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.661472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 211/423] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:34.663000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.749540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.775538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c3d6c-f897-4e51-be60-24187d73d6cc None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.814816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.815500 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.815824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.816100 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.819120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.819120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.825359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 213/424] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:34.827872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.846492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.899550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.949738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf46d6-68c8-485c-8219-92914255e1e3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.994056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe611a-bf42-4504-a359-41f2c39bc129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.995268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe611a-bf42-4504-a359-41f2c39bc129 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.995716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe611a-bf42-4504-a359-41f2c39bc129 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.996121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe611a-bf42-4504-a359-41f2c39bc129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.996963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe611a-bf42-4504-a359-41f2c39bc129 None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:34.997414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe611a-bf42-4504-a359-41f2c39bc129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.998972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe611a-bf42-4504-a359-41f2c39bc129 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:35.010137 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 214/425] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:35.017510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0fde9-165d-4a93-b055-b2ce2dfd6132 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:35.104834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:35.105502 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.105776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.106045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.113899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edda8f-ac1b-4743-9430-cbae0827ff5e None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.114210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edda8f-ac1b-4743-9430-cbae0827ff5e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.114456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edda8f-ac1b-4743-9430-cbae0827ff5e None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.116193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 215/426] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:35.121846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163e13-80a3-449c-8d24-67d0f66e3ded None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.122135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163e13-80a3-449c-8d24-67d0f66e3ded None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.122415 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163e13-80a3-449c-8d24-67d0f66e3ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.137806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:35.143002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:35.144005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:35.150400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 212/427] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:35.151125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:35.151951 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-32163e13-80a3-449c-8d24-67d0f66e3ded None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:35.153163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-32163e13-80a3-449c-8d24-67d0f66e3ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:35.255223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 216/428] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:35.289260 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525ce9-2fcc-4fb6-b94f-2ff690798b17 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:35.307980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:35.327640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:35.334267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.334267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.334267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.334267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:35.334267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:35.334267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:35.342584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 213/429] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:35.347974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32163e13-80a3-449c-8d24-67d0f66e3ded None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:35.366089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:35.474314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32163e13-80a3-449c-8d24-67d0f66e3ded None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:35.514285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:35.514824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.515117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.515396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.590461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:35.590973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:35.593308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:35.604151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:35.729923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 217/430] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:35.736299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:35.740190 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c88e9b-56ca-47e6-9eaf-0bda825c702d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:35.794730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:35.795735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.796181 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.796636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.813282 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:35.820938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:35.821880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:46:35.822688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:35.825810 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 214/431] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:35.831859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:35.880727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:35.880923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d3acb-3f04-4092-a18f-9c71bd73e5a7 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:35.892356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:35.928512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df609d03-e282-464e-ba56-9bd2c5233547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:35.929162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df609d03-e282-464e-ba56-9bd2c5233547 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.931180 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df609d03-e282-464e-ba56-9bd2c5233547 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.931180 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df609d03-e282-464e-ba56-9bd2c5233547 None admin] PATH_INFO: `/v3/projects/71ff6b9731cb4eae9ad324df59928ed5` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.931414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df609d03-e282-464e-ba56-9bd2c5233547 None admin] RBAC: Authorizing `identity:get_project(project_id=71ff6b9731cb4eae9ad324df59928ed5)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:35.932845 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df609d03-e282-464e-ba56-9bd2c5233547 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:35.934863 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 218/432] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:35 2022] GET /identity/v3/projects/71ff6b9731cb4eae9ad324df59928ed5 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:35.940402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3a58-e99f-4229-8780-8b499928dc2e None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.940666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3a58-e99f-4229-8780-8b499928dc2e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.940942 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3a58-e99f-4229-8780-8b499928dc2e None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.942398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 219/433] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:35.942982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e3a58-e99f-4229-8780-8b499928dc2e None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:35.978199 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2cb1-8bb7-4b1b-af58-5868e52d3896 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.015364 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa832e2-569f-4c36-b852-b1e11a561a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.016082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa832e2-569f-4c36-b852-b1e11a561a09 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.016359 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa832e2-569f-4c36-b852-b1e11a561a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.016639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa832e2-569f-4c36-b852-b1e11a561a09 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.017337 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa832e2-569f-4c36-b852-b1e11a561a09 None admin] RBAC: Adding query filter params (name=member) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:36.017634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa832e2-569f-4c36-b852-b1e11a561a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:36.019271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa832e2-569f-4c36-b852-b1e11a561a09 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:36.028953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 215/434] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:36.030104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040952-1b93-432e-8c56-b1bb323ea4f3 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.030391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040952-1b93-432e-8c56-b1bb323ea4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.030726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040952-1b93-432e-8c56-b1bb323ea4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.050069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-74040952-1b93-432e-8c56-b1bb323ea4f3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:36.051330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-74040952-1b93-432e-8c56-b1bb323ea4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:36.061289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e3a58-e99f-4229-8780-8b499928dc2e None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.100659 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.101387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.101674 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.103242 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:36.104705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:36.106288 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 220/435] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:35 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:36.107059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.139124 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 216/436] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:36.139124 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74040952-1b93-432e-8c56-b1bb323ea4f3 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.165902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:36.169827 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:36.222627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dc854-8035-413d-a3e5-cc5c89b53086 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.248312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74040952-1b93-432e-8c56-b1bb323ea4f3 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.259510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.260113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.260385 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.260820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.285796 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56b10-fdf3-42dc-a315-ea59097efc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.286398 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56b10-fdf3-42dc-a315-ea59097efc5c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.286672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56b10-fdf3-42dc-a315-ea59097efc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56b10-fdf3-42dc-a315-ea59097efc5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.287696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e56b10-fdf3-42dc-a315-ea59097efc5c None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=71ff6b9731cb4eae9ad324df59928ed5) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:36.287996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e56b10-fdf3-42dc-a315-ea59097efc5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:36.290015 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e56b10-fdf3-42dc-a315-ea59097efc5c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:36.296383 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 217/437] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=71ff6b9731cb4eae9ad324df59928ed5&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:36.297967 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3508e-dbcf-472f-98e3-b1b5e2a0574b None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.298523 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3508e-dbcf-472f-98e3-b1b5e2a0574b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.299016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3508e-dbcf-472f-98e3-b1b5e2a0574b None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.300603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 218/438] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:36.309375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930c07-ec60-49d2-87b3-5e126fa07fe2 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.309704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930c07-ec60-49d2-87b3-5e126fa07fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.309919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930c07-ec60-49d2-87b3-5e126fa07fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.332672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-d2930c07-ec60-49d2-87b3-5e126fa07fe2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:36.334205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d2930c07-ec60-49d2-87b3-5e126fa07fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:36.350133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:36.352823 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:36.415284 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:36.426396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 219/439] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:36.429951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930c07-ec60-49d2-87b3-5e126fa07fe2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.456342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:36.487327 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 221/440] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:36.495264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.559803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930c07-ec60-49d2-87b3-5e126fa07fe2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.596798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.597768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.598049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.598325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.611000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:36.615876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:36.616817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:36.618255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 220/441] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:36.623446 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.630547 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2a5e-d12c-4019-ba09-5018ad8d53f7 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.683503 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.684141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.684418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.684687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.685815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:36.687718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:36.689096 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 222/442] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:36.694267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.713051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:36.731323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:36.753793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ba1c1-13a3-4884-aefe-6cdabcf3cd03 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.790420 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.791028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.791372 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.791665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.794516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:36.794516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:36.794516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:36.802415 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 221/443] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:36.803271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.817882 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe65f2f-3872-4561-b912-3e57eae98444 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.856172 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.856804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.857079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.857358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.858491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:36.859965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:36.861540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 223/444] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:36.863921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.910885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c97b42-af01-4053-a189-6ea0b7cd8009 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.943952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:36.944572 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.945395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.945693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.948532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:36.955710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:36.961658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:36.962701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:36.963575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 222/445] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:36.964245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:36.968342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb0cc-d7c0-4116-86cd-94882ab78f10 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:36.968929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.004024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.004633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.004906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.005176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.066551 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65186-ff2e-45ea-bbb8-5b8e73711cb8 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.072679 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.074089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.101829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.102602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.102876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.103170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.103892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=70eb8f7fc9b340d3a20422a2225491fd, scope.project.id=2f1e914fe128421190cf9ad952d634c0) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:37.104202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.105639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.111483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 223/446] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=70eb8f7fc9b340d3a20422a2225491fd => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:37.114464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.159597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.187299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 224/447] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:37.188917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.209339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656df8db-66c4-4ca8-967f-5c3a1213c38f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.292712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.293330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.293604 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.293875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.294547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:37.294849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.296935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.301231 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed4b9-7d47-4fdf-8afd-59e48c66fb5a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.306447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 224/448] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:37.312371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.345931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.346812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.347093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.347451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] PATH_INFO: `/v3/projects/2f1e914fe128421190cf9ad952d634c0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.348664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] RBAC: Authorizing `identity:get_project(project_id=2f1e914fe128421190cf9ad952d634c0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.350173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.352430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 225/449] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/projects/2f1e914fe128421190cf9ad952d634c0 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:37.358921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.414116 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.430991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4289f6e-68a0-4e1e-b9b5-cd81ebec1c65 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.466834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.473080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b7166-3141-4fc3-af3a-b9185268b8ed None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.473839 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.474931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.474931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.475129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.511721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.512363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.512640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.512908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] PATH_INFO: `/v3/groups/6d1caf025beb4af48dc42d8d031320b7` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.514028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] RBAC: Authorizing `identity:get_group(group_id=6d1caf025beb4af48dc42d8d031320b7)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.515616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.517190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 226/450] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/groups/6d1caf025beb4af48dc42d8d031320b7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:37.523248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.547068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.548547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.624521 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df999ead-36c8-4f97-b993-9521a70688ae None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.641333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.652812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 225/451] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:46:37.658631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.659732 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.660345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.660629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.660890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.661610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] RBAC: Adding query filter params (group.id=6d1caf025beb4af48dc42d8d031320b7, role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=2f1e914fe128421190cf9ad952d634c0) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:37.661913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.663424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.672119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 227/452] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/role_assignments?group.id=6d1caf025beb4af48dc42d8d031320b7&scope.project.id=2f1e914fe128421190cf9ad952d634c0&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:37.689376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.766361 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771526c4-41a8-4df8-8fda-a0266d667deb None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.801804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.802438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.802713 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.802984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] PATH_INFO: `/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.804738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] RBAC: Authorizing `identity:get_project(project_id=b4a5e2ed24234c04bb44f2eb019170b1)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.806175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.807848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 226/453] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/projects/b4a5e2ed24234c04bb44f2eb019170b1 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:37.813536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.922045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cac3e-b984-4b99-94ee-198cec06a7c3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.955992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180d070-e803-412a-bd32-4b6b0de02baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.956631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d070-e803-412a-bd32-4b6b0de02baf None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.956908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d070-e803-412a-bd32-4b6b0de02baf None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.957199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d070-e803-412a-bd32-4b6b0de02baf None admin] PATH_INFO: `/v3/groups/96b268c5814e4970817ced44764a5e48` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.958282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180d070-e803-412a-bd32-4b6b0de02baf None admin] RBAC: Authorizing `identity:get_group(group_id=96b268c5814e4970817ced44764a5e48)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.959820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180d070-e803-412a-bd32-4b6b0de02baf None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.961918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 228/454] 10.222.0.58 () {56 vars in 1180 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/groups/96b268c5814e4970817ced44764a5e48 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:37.968202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:38.071163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:38.074900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b272905-3ad7-41a4-b7a0-c884a4f89d64 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:38.108904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e265a-a10b-4641-b212-920aeb711c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:38.109490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e265a-a10b-4641-b212-920aeb711c47 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:38.109765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e265a-a10b-4641-b212-920aeb711c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:38.110033 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e265a-a10b-4641-b212-920aeb711c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:38.110749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e265a-a10b-4641-b212-920aeb711c47 None admin] RBAC: Adding query filter params (group.id=96b268c5814e4970817ced44764a5e48, role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=b4a5e2ed24234c04bb44f2eb019170b1) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:38.111050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e265a-a10b-4641-b212-920aeb711c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:38.112498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e265a-a10b-4641-b212-920aeb711c47 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:38.118751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 227/455] 10.222.0.58 () {56 vars in 1376 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/role_assignments?group.id=96b268c5814e4970817ced44764a5e48&scope.project.id=b4a5e2ed24234c04bb44f2eb019170b1&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:40.369342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879e6e-6154-45ed-a3ea-365bff363701 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.369854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879e6e-6154-45ed-a3ea-365bff363701 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.369854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879e6e-6154-45ed-a3ea-365bff363701 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.371250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 229/456] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:40.376844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286b1c-a6e4-4c09-9d5a-4cb31b69e2d8 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.377301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286b1c-a6e4-4c09-9d5a-4cb31b69e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.377386 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c286b1c-a6e4-4c09-9d5a-4cb31b69e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.404109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-6c286b1c-a6e4-4c09-9d5a-4cb31b69e2d8 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:40.405316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6c286b1c-a6e4-4c09-9d5a-4cb31b69e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:40.505752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 228/457] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:46:40.542769 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1273c-ef47-4de2-a5e3-6bf683d8831a None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.543414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1273c-ef47-4de2-a5e3-6bf683d8831a None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.543898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1273c-ef47-4de2-a5e3-6bf683d8831a None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.545665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 230/458] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:40.550608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c6d3d-ef9b-45e4-9864-d7c811c95098 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.550894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c6d3d-ef9b-45e4-9864-d7c811c95098 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.551207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c6d3d-ef9b-45e4-9864-d7c811c95098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.578564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-9a2c6d3d-ef9b-45e4-9864-d7c811c95098 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:40.579792 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-9a2c6d3d-ef9b-45e4-9864-d7c811c95098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:40.694837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 229/459] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:40.863911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1273c-ef47-4de2-a5e3-6bf683d8831a None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:40.926980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:41.000750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1273c-ef47-4de2-a5e3-6bf683d8831a None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.050196 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.050838 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.051347 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.051449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.052629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c6d3d-ef9b-45e4-9864-d7c811c95098 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:41.063981 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.065468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:41.081841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:41.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:41.083713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:41.083713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:41.083713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:41.086705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 231/460] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:41.089352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:41.109813 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:41.211121 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c6d3d-ef9b-45e4-9864-d7c811c95098 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.231835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:41.235139 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb37d-d08b-460c-80bb-61d0289c1c46 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.250362 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bc9a3-1f56-4746-9bef-7dddf875086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.251032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc9a3-1f56-4746-9bef-7dddf875086a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.251334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc9a3-1f56-4746-9bef-7dddf875086a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.251604 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc9a3-1f56-4746-9bef-7dddf875086a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.262981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bc9a3-1f56-4746-9bef-7dddf875086a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.264489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bc9a3-1f56-4746-9bef-7dddf875086a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:41.273965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606c5e5-9617-455e-843f-59da72e02bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.274616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606c5e5-9617-455e-843f-59da72e02bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.274890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606c5e5-9617-455e-843f-59da72e02bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.275312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606c5e5-9617-455e-843f-59da72e02bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.275958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606c5e5-9617-455e-843f-59da72e02bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:41.278362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606c5e5-9617-455e-843f-59da72e02bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.278362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606c5e5-9617-455e-843f-59da72e02bc5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-9e1bc9a3-1f56-4746-9bef-7dddf875086a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:41.282073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:41.282978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:41.284213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:41.284213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:41.284213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:41.284213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 230/461] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:41.285564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812a3a-964b-4a9a-af50-b24b51dff1a9 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.285564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812a3a-964b-4a9a-af50-b24b51dff1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.287552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812a3a-964b-4a9a-af50-b24b51dff1a9 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.291791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 231/462] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:41.292736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812a3a-964b-4a9a-af50-b24b51dff1a9 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:41.297295 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 232/463] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:41.298559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1724-8245-40aa-a4ba-139f54eceba2 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.298846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1724-8245-40aa-a4ba-139f54eceba2 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.299135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1724-8245-40aa-a4ba-139f54eceba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.318141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-7efb1724-8245-40aa-a4ba-139f54eceba2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:41.319398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-7efb1724-8245-40aa-a4ba-139f54eceba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:41.377686 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:41.394829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 233/464] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:41.396296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1724-8245-40aa-a4ba-139f54eceba2 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:41.419905 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812a3a-964b-4a9a-af50-b24b51dff1a9 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.479533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cacdbf-205a-4924-854d-15335132f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.479865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cacdbf-205a-4924-854d-15335132f972 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.480127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cacdbf-205a-4924-854d-15335132f972 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.480399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cacdbf-205a-4924-854d-15335132f972 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.481047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cacdbf-205a-4924-854d-15335132f972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:41.481341 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cacdbf-205a-4924-854d-15335132f972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.482704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cacdbf-205a-4924-854d-15335132f972 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:41.495634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 232/465] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:41.496507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:41.497275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a45f37-de00-459f-8514-30847a38a6c7 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.497560 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a45f37-de00-459f-8514-30847a38a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.497833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a45f37-de00-459f-8514-30847a38a6c7 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.499198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 233/466] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:41.504018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a45f37-de00-459f-8514-30847a38a6c7 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:41.509490 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1724-8245-40aa-a4ba-139f54eceba2 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.547651 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0b2b-c13b-4ece-94f0-9e9da8379b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.548359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0b2b-c13b-4ece-94f0-9e9da8379b93 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.548700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0b2b-c13b-4ece-94f0-9e9da8379b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.549109 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0b2b-c13b-4ece-94f0-9e9da8379b93 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.549814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0b2b-c13b-4ece-94f0-9e9da8379b93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.551430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0b2b-c13b-4ece-94f0-9e9da8379b93 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:41.611519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a45f37-de00-459f-8514-30847a38a6c7 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.655591 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 234/467] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:41 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:41.657148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f164b-220a-4aac-b04f-fed408bac639 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.658640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f164b-220a-4aac-b04f-fed408bac639 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.658938 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f164b-220a-4aac-b04f-fed408bac639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.659928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.660553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.660825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.661092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.669527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.670782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:41.691147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:41.701734 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-657f164b-220a-4aac-b04f-fed408bac639 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:41.705352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-657f164b-220a-4aac-b04f-fed408bac639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:41.777017 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 234/468] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:41 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:41.777989 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:41.786490 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 235/469] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:41.855854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b616-c966-4107-b4bb-f84c55317edf None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.856479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b616-c966-4107-b4bb-f84c55317edf None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.856778 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b616-c966-4107-b4bb-f84c55317edf None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.858300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 236/470] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:41.863810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000be0c-31f4-4c94-a54e-9881c4e0917c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.864401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000be0c-31f4-4c94-a54e-9881c4e0917c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.864914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000be0c-31f4-4c94-a54e-9881c4e0917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.888342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-8000be0c-31f4-4c94-a54e-9881c4e0917c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:41.890072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8000be0c-31f4-4c94-a54e-9881c4e0917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:41.942084 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c1551-6037-45f7-98da-1ff49f13cf7d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.982669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.983059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.983358 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.983629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.989691 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 237/471] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:46:41.997415 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.998879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:42.014489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:42.015456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:42.016323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:42.016323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:42.016323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.016323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 235/472] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:42.021505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000be0c-31f4-4c94-a54e-9881c4e0917c None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.031309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:42.108550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.136495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000be0c-31f4-4c94-a54e-9881c4e0917c None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:42.179408 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:42.191886 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:42.193064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.193345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.193615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.195110 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:42.195502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:42.197852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:42.218160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 238/473] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:42.223923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.282832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ccbb7-9c7b-4c8b-8ed9-b9062a4bcfb5 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:42.324081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:42.324724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.325002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.325275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.331139 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:42.338528 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:42.341828 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:42.360107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:42.361089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:42.362159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:42.362159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:42.362159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.362159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 236/474] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:42.362159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388029a-80d7-41b7-aed0-22a228a4748d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:42.425006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:42.425617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.425895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.426167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.426883 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:42.428435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:42.477128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:42.484047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768390ee-e937-4e0d-811a-75d9b5e95862 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:42.518482 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:42.519170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.519450 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.519763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.520440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:42.521875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:42.547233 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 239/475] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:42 2022] POST /identity/v3/users => generated 248 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:46:42.547233 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.560935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.sql.core [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:46:42.560935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:46:42.560935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [parameters: {'id': 'ae94c510f1d64e21a17e9a6e2ab065db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:46:42.560935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result.read() Aug 28 00:46:42.588289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:46:42.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application yield resource Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise self.value Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application session.commit() Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:46:42.590198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:46:42.591067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:46:42.591979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result.read() Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:46:42.593083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [parameters: {'id': 'ae94c510f1d64e21a17e9a6e2ab065db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:42.593874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:46:42.594693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.598042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 237/476] 10.222.0.58 () {60 vars in 1131 bytes} [Sun Aug 28 00:46:42 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:42.603561 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.699193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffa5d-666c-4c0e-8744-e78060f9ccab None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:42.735129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:42.749827 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:42.750890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.751415 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.751904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.752840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:42.753340 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:42.755597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:42.772848 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 240/477] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:42.782345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.796179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f82577-a28d-4047-8ab2-d7e72cb7439c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:42.854856 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:42.855442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.855716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.855987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.871950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:42.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:42.880270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:42.881102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 238/478] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:42.888062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:42.917028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:42.933903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3594ea-3f53-4aeb-b01d-59bc5bf90a85 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:42.977789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf5ab9-349e-4593-860e-347a268898c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:42.978463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5ab9-349e-4593-860e-347a268898c5 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:42.978744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5ab9-349e-4593-860e-347a268898c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:42.979016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5ab9-349e-4593-860e-347a268898c5 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:42.979880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf5ab9-349e-4593-860e-347a268898c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:42.981909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf5ab9-349e-4593-860e-347a268898c5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:43.025990 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7c16-deb5-456d-a3c0-24122691bb7b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:43.071136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275a67-8abb-4395-8c74-2bdec29d4bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:43.071793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275a67-8abb-4395-8c74-2bdec29d4bba None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.072081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275a67-8abb-4395-8c74-2bdec29d4bba None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.072338 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275a67-8abb-4395-8c74-2bdec29d4bba None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.073091 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275a67-8abb-4395-8c74-2bdec29d4bba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:43.073399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275a67-8abb-4395-8c74-2bdec29d4bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:43.074825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275a67-8abb-4395-8c74-2bdec29d4bba None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:43.090505 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 239/479] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:43.219758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 241/480] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:42 2022] POST /identity/v3/users => generated 249 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:43.944380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c444-c4c0-41f0-b24c-7cbd3008ee54 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.944952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c444-c4c0-41f0-b24c-7cbd3008ee54 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.944952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c444-c4c0-41f0-b24c-7cbd3008ee54 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.946472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 240/481] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:43.951951 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6493ecd-8e49-4102-827c-44806a37a537 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.952376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6493ecd-8e49-4102-827c-44806a37a537 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.952544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6493ecd-8e49-4102-827c-44806a37a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.976815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d6493ecd-8e49-4102-827c-44806a37a537 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:43.978365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d6493ecd-8e49-4102-827c-44806a37a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:44.025710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:44.081708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 242/482] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:46:44.224838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d174-a5ce-468a-b142-5eb1ab86c341 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:44.225009 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d174-a5ce-468a-b142-5eb1ab86c341 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:44.225290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d174-a5ce-468a-b142-5eb1ab86c341 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:44.227552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 241/483] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:44.233247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fd0da-346a-4101-adaa-c1abd642f034 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:44.233535 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fd0da-346a-4101-adaa-c1abd642f034 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:44.233807 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fd0da-346a-4101-adaa-c1abd642f034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:44.252179 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-477fd0da-346a-4101-adaa-c1abd642f034 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:44.253683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-477fd0da-346a-4101-adaa-c1abd642f034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:44.340361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 243/484] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:44.561511 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d174-a5ce-468a-b142-5eb1ab86c341 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:44.655991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fd0da-346a-4101-adaa-c1abd642f034 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:44.673941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:44.716459 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d174-a5ce-468a-b142-5eb1ab86c341 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:44.781399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:44.782423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:44.782939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:44.783417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:44.802036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:44.809316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:44.810270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:44.811082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:44.819346 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 242/485] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:44.824095 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:44.836007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:44.843800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fd0da-346a-4101-adaa-c1abd642f034 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:44.907462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:44.908102 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:44.908376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:44.908643 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:44.928678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:44.933926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:44.934817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:44.935697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:44.938289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 244/486] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:44.946671 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.008590 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a77d0-b466-4175-911c-2304dbdc5990 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.051269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73e078-abe9-44f5-a33e-b4bf7d558334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.052234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73e078-abe9-44f5-a33e-b4bf7d558334 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.052712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73e078-abe9-44f5-a33e-b4bf7d558334 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.053181 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73e078-abe9-44f5-a33e-b4bf7d558334 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.054261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73e078-abe9-44f5-a33e-b4bf7d558334 None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:45.054974 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73e078-abe9-44f5-a33e-b4bf7d558334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:45.056722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73e078-abe9-44f5-a33e-b4bf7d558334 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:45.066564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 243/487] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:45.068288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfc6c-9260-4b68-9a9d-4929331b42a9 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.068773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfc6c-9260-4b68-9a9d-4929331b42a9 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.069333 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfc6c-9260-4b68-9a9d-4929331b42a9 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.071815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 244/488] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:45.076092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfc6c-9260-4b68-9a9d-4929331b42a9 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.080235 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:45.126856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c325798-ece7-417d-bf93-728b1308db88 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.164549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dd7c3-8307-489e-8011-53166f7ef90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.165240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dd7c3-8307-489e-8011-53166f7ef90c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.165517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dd7c3-8307-489e-8011-53166f7ef90c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.165786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dd7c3-8307-489e-8011-53166f7ef90c None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.166738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dd7c3-8307-489e-8011-53166f7ef90c None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:45.166952 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dd7c3-8307-489e-8011-53166f7ef90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:45.168567 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dd7c3-8307-489e-8011-53166f7ef90c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:45.182478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 245/489] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:45.183907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7609e0-c5a7-440a-8ad6-4d58a36feffb None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.184191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7609e0-c5a7-440a-8ad6-4d58a36feffb None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.184460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7609e0-c5a7-440a-8ad6-4d58a36feffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.193172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfc6c-9260-4b68-9a9d-4929331b42a9 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.204081 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-5f7609e0-c5a7-440a-8ad6-4d58a36feffb None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:45.205402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5f7609e0-c5a7-440a-8ad6-4d58a36feffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:45.221259 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:45.233018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.234602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.235294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.235670 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.251005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:45.252644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:45.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:45.272325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:45.273741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:45.273741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:45.273741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:45.273741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 245/490] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:45.274682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.295450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 246/491] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:45.295450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7609e0-c5a7-440a-8ad6-4d58a36feffb None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.406384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7609e0-c5a7-440a-8ad6-4d58a36feffb None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.418117 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:45.464770 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.465417 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.465694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.465965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.466615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:45.467187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:45.468569 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:45.481113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 247/492] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:45.488277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.516305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:45.537920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a2d70-f460-4dd0-87d3-307814571577 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.588697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1a9b-68db-4dea-adda-f9b9a64e89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.589613 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1a9b-68db-4dea-adda-f9b9a64e89d6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.589892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1a9b-68db-4dea-adda-f9b9a64e89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.590169 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1a9b-68db-4dea-adda-f9b9a64e89d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.606466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e1a9b-68db-4dea-adda-f9b9a64e89d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:45.607560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da462e9-ae24-452f-98b3-72a11e326fca None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.607983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e1a9b-68db-4dea-adda-f9b9a64e89d6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-4f4e1a9b-68db-4dea-adda-f9b9a64e89d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:45.627310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:45.628296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:45.629153 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:45.629153 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:45.629153 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:45.629319 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 246/493] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:45.630469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ab40e-2738-4c5b-b43b-dadb542b3157 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.630753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ab40e-2738-4c5b-b43b-dadb542b3157 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.631026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ab40e-2738-4c5b-b43b-dadb542b3157 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.633375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 247/494] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:45.635937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ab40e-2738-4c5b-b43b-dadb542b3157 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.657413 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.658130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.658482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.658776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.668641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:45.669633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:45.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:45.685234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:45.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:45.690056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 248/495] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:45.690792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.760541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ab40e-2738-4c5b-b43b-dadb542b3157 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.768125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:45.783994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:45.800569 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f0b89-d8c7-483b-8c8e-10f0bcfd9f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.801201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f0b89-d8c7-483b-8c8e-10f0bcfd9f62 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.801476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f0b89-d8c7-483b-8c8e-10f0bcfd9f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.801744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f0b89-d8c7-483b-8c8e-10f0bcfd9f62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.812661 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f0b89-d8c7-483b-8c8e-10f0bcfd9f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-045f0b89-d8c7-483b-8c8e-10f0bcfd9f62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:45.817567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:45.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:45.820226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:45.820956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0435011-8de9-41a2-a7e9-2952443f7c80 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:45.821030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 248/496] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:45.821030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149f39-253d-4532-a8ec-7cf58fd797a2 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.821148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149f39-253d-4532-a8ec-7cf58fd797a2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.821535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149f39-253d-4532-a8ec-7cf58fd797a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.840998 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-08149f39-253d-4532-a8ec-7cf58fd797a2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:45.842465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-08149f39-253d-4532-a8ec-7cf58fd797a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:45.861916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:45.862532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.862811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.863084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.863752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:45.864061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:45.865461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:45.883178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 249/497] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:45.883178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.916787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 249/498] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:45.917553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08149f39-253d-4532-a8ec-7cf58fd797a2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:45.992557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462789-17a4-4c60-bcbf-4a6566c6a328 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.017936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.024383 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08149f39-253d-4532-a8ec-7cf58fd797a2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.024716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.030960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.031654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.032048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.032337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.033065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:46.033369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.034996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.063672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91781953-4ff9-4565-9632-2dd8086ca405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.064291 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781953-4ff9-4565-9632-2dd8086ca405 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.064568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781953-4ff9-4565-9632-2dd8086ca405 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.064841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781953-4ff9-4565-9632-2dd8086ca405 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.065509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91781953-4ff9-4565-9632-2dd8086ca405 None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:46.065812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91781953-4ff9-4565-9632-2dd8086ca405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.067195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91781953-4ff9-4565-9632-2dd8086ca405 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.079318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 250/499] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:46.079318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.079553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 250/500] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:46.079553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c46a4-fa8d-46db-a07b-6230517b5d6c None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.079553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c46a4-fa8d-46db-a07b-6230517b5d6c None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.079553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c46a4-fa8d-46db-a07b-6230517b5d6c None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.079809 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 251/501] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:46.081235 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c46a4-fa8d-46db-a07b-6230517b5d6c None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.188197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c46a4-fa8d-46db-a07b-6230517b5d6c None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.191302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71e232-f72e-4e71-a3d5-f06efd0eb3ea None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.224239 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3f6c3-18e0-4223-811d-095d08c11fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.224844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3f6c3-18e0-4223-811d-095d08c11fac None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.225120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3f6c3-18e0-4223-811d-095d08c11fac None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.225393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3f6c3-18e0-4223-811d-095d08c11fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.226355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.227240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.227524 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.227799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.234916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.236398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:46.248888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 251/502] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:46.249784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.258603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.297952 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.300680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3f6c3-18e0-4223-811d-095d08c11fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.302143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3f6c3-18e0-4223-811d-095d08c11fac None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.349388 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b397f-422d-4314-8b48-4d45db02c92f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.383435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.384049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.384324 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.384593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.396111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.398229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.401910 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 252/503] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:46.406510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11208-cf57-4f25-be66-42c34ca88152 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.406510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11208-cf57-4f25-be66-42c34ca88152 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.406510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11208-cf57-4f25-be66-42c34ca88152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:46.412798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:46.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:46.414711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:46.414711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:46.414711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:46.414711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 252/504] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:46.415362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.424926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-56c11208-cf57-4f25-be66-42c34ca88152 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:46.426134 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-56c11208-cf57-4f25-be66-42c34ca88152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:46.479855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.493438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 253/505] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:46.494255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c11208-cf57-4f25-be66-42c34ca88152 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.515366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.518243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc04c-efec-47b3-8c2e-1e9ef6a9829d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.554783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636924-a282-43aa-a56f-113040d3571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.555445 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636924-a282-43aa-a56f-113040d3571e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.555727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636924-a282-43aa-a56f-113040d3571e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.555995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636924-a282-43aa-a56f-113040d3571e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.566717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636924-a282-43aa-a56f-113040d3571e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.568176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636924-a282-43aa-a56f-113040d3571e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-40636924-a282-43aa-a56f-113040d3571e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:46.582844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:46.583804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:46.584711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:46.584711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:46.584711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:46.584711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 253/506] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:46.587963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636924-a282-43aa-a56f-113040d3571e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.599695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c11208-cf57-4f25-be66-42c34ca88152 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.640853 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.641452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.641727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.642000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.642730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:46.643030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.644655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.695163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 254/507] 10.222.0.58 () {56 vars in 1137 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:46.695163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.700135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636924-a282-43aa-a56f-113040d3571e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.736541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.737465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.737745 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.738017 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.744723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.750337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.751940 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:46.767200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:46.768160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:46.769013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:46.769013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:46.769013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:46.769013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 254/508] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:46.769227 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.773418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.806313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944421-73af-4df4-91df-ea87cf6452c3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.840053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.840686 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.840962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.841233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.842129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:46.842435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.843835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.855926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 255/509] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:46.856562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.879956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88593ff3-1c0c-4bfe-bbd2-e6b5d88abc22 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.914353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.914957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.915268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.915544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.916178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:46.916480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.917870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.929669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 255/510] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:46.930375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.958390 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1fe3e-77ba-4931-98a5-65b81394febe None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.965879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.992996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.995072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.995802 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.996172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.996526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.032436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ac8f8-9a9e-46aa-a6a1-54d767e21aad None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.066260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.066875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.067178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.067450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.077816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:47.082573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:47.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:47.084485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 256/511] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:47.085718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.087057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.088567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.187394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297fa2a-509c-466f-8c23-d7243f8ce12e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.193352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 256/512] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:47.194195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.206347 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.212199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.222753 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.223401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.223680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.223962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.224599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:47.224924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.226933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.238805 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 257/513] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:47.242644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.300065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc776f5-5ec5-4554-abe5-de417d33b4dd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.333650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.334268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.334539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.334806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.341369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a97b-ed36-4315-a2f6-2ad6f7dca5cc None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.342394 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.343864 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:47.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:47.358243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 257/514] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:47.359194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.378085 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.378694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.378970 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.379267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.379908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.381348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.429157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.457435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 258/515] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:47 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:47.458379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.465647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbd429-95bb-4b49-8eb0-255f636dfae3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.506800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.507497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.508105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.508997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.509418 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.510125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:47.510430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.511976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.526399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 258/516] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:47.526399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.585921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1bbd0-5f27-491e-8b48-ebf77017db1b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.625335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.625959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.626243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.626512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.643195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.645830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.652243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994d773-f3c2-4c1c-8d22-c698ec860b4f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:47.663168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:47.665424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:47.667079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:47.667079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:47.667079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:47.667079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 259/517] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:47.667079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.692462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.701112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.701745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.706494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.706494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.709280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.710895 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:47.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:47.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:47.726679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 259/518] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:47.732943 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.776604 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.785878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57670f-67a8-4761-a181-f162f6edc736 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.825562 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.826176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.826451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.826726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.827493 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:47.827799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.829223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.837304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef3dd-23cb-4521-9fdf-9a47005a6bd6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:47.849045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 260/519] 10.222.0.58 () {56 vars in 1137 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:47.849045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.880408 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:47.881027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:47.881313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:47.881569 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:47.893101 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:47.894624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:47.909797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:47.910788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:47.912045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:47.912045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:47.912045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:47.912045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 260/520] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:47.912045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:47.959547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:47.972632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eadf4a-31bd-4d91-9b24-e7ded8b83bad None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.021375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.021986 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.022286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.023202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.023852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:48.024151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.025559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.032499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343679d-2ec9-4d43-9135-b0cf505fe562 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.039351 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 261/521] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:48.040458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.055375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:48.074728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.075371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.075647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.075919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.076617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:48.076923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.078356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.098791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 261/522] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:48.100423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.162294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c929-4536-4494-9401-e6022fc23231 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.205075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.205814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.206089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.206423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.208575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:48.212120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c941ca-aa24-4d2d-ad62-0b5fab8543f8 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.251286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.251964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.252189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.252454 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.253108 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:48.253405 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.254837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.267643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 262/523] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:48.268495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.291251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.293820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.305818 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:48.383129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944e5a-e864-43ea-840d-6b4bc8ce3c28 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.396695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 262/524] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:48.398108 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.426611 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.427612 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.428127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.428556 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.436743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.438374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:48.451290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:48.452348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:48.453389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:48.455136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 263/525] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:48.456047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.481387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:48.514237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b673027-afb0-42cd-bf33-417b6f9bf0c1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.530770 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:48.562550 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.563228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.563507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.563779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.564089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3388-696d-4147-bed1-16d29e06f420 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.564505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=d1cdc7db1f714849ba14a987d2412591) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:48.564810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.567055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.583128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 263/526] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/role_assignments?user.id=d1cdc7db1f714849ba14a987d2412591&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:48.583128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.626287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.626634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.626971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.635864 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.637387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:48.654285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:48.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:46:48.656226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:48.657519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 264/527] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:48.658452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.731139 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0b9d4-ddee-4858-880c-801bfaf7f17a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.776214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:48.780039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.780972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.781389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.781988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.796070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.798401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.800879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0ce08-737f-4d06-af3c-f142060ba008 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:48.820692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:48.821692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:48.822585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:48.822585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:48.822585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:48.825243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 264/528] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:48.826509 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.849800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.850791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.851306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.851747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.852609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:48.853069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.854645 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:48.862886 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:48.868584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 265/529] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:48.869636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.952373 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5fa2-bd97-48c2-ba05-b2112bba722c None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.975317 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41272f87-44bc-477c-bbfd-ee9f7d485af1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.988843 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.989454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.989755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.990002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.990739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:48.992035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:48.993335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.012858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.013413 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 265/530] 10.222.0.58 () {56 vars in 1139 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.014089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.014381 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.014764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.015283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.016151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:49.016766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.018451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.032165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 266/531] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.033378 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.043168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.114345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.133191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18c4f-9d38-40d7-9e6c-345526a5a2e8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.140729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85a229-f058-472e-bb10-bf0d1671b300 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.171833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.172854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.173337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.173805 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.174828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=9bc80df87ba14b3595e171a0e8fd6f88) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:49.175467 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.177295 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.177655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.178264 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.178537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.179404 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.184937 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 266/532] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/role_assignments?user.id=9bc80df87ba14b3595e171a0e8fd6f88&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.186126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.254945 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.255426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.259844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.300367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5ff32-671d-49a9-b97f-04a1ec524ebd None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.340551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.341555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.342289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.342755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.350574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.352959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:49.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:49.367331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:49.368325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:49.370108 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 267/533] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:49.370871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 267/534] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:49.376076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.377223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.402133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.531024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fef2b-ed01-498f-89ff-8a797db923e9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.569521 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5faf4b-243d-4283-b499-7c652c780994 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.575133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.575133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.575133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.575133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.575497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:49.575497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.575616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.576361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.598775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 268/535] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.606662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.641574 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b575ad-7744-46f7-b294-805b180297e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.642546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b575ad-7744-46f7-b294-805b180297e2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.642836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b575ad-7744-46f7-b294-805b180297e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.643312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b575ad-7744-46f7-b294-805b180297e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.657568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b575ad-7744-46f7-b294-805b180297e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.659914 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b575ad-7744-46f7-b294-805b180297e2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-81b575ad-7744-46f7-b294-805b180297e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:49.680520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:49.681480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:49.682332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:49.682332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:49.682332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:49.683015 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 268/536] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:49.684652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58eb47-7325-4bcf-9512-10494433b8de None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.684652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58eb47-7325-4bcf-9512-10494433b8de None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.684652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58eb47-7325-4bcf-9512-10494433b8de None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.685711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 269/537] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:49.694065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58eb47-7325-4bcf-9512-10494433b8de None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.704315 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.749710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18323695-edb8-43f3-83d0-e748d739be1a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.793190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fb276-481e-4e98-acc1-376ab8fd1d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.793785 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb276-481e-4e98-acc1-376ab8fd1d3c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.794062 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb276-481e-4e98-acc1-376ab8fd1d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.794336 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb276-481e-4e98-acc1-376ab8fd1d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.795704 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fb276-481e-4e98-acc1-376ab8fd1d3c None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=c481bcb02495453f806fdc6a9d30ed58) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:49.796020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fb276-481e-4e98-acc1-376ab8fd1d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.797984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fb276-481e-4e98-acc1-376ab8fd1d3c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.811198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 269/538] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/role_assignments?user.id=c481bcb02495453f806fdc6a9d30ed58&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:49.812665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a3b0-f386-4202-af13-7931909d4638 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.812948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a3b0-f386-4202-af13-7931909d4638 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.813222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a3b0-f386-4202-af13-7931909d4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.843609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58eb47-7325-4bcf-9512-10494433b8de None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.856302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e7f4a3b0-f386-4202-af13-7931909d4638 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:49.857560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e7f4a3b0-f386-4202-af13-7931909d4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:49.884507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.885305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.885586 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.885857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.886523 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:49.886826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.888287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.903166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 270/539] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.908802 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.927545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.978878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 270/540] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:50.048002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb9aec-8491-4219-ab61-1d97bce37fc5 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:50.116363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:50.116999 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.117332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.117602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.130212 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:50.132265 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:50.151197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:50.152833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:50.153921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 271/541] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:50.158158 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4a3b0-f386-4202-af13-7931909d4638 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:50.239401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:50.281408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4a3b0-f386-4202-af13-7931909d4638 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:50.317602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:50.317767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:50.318335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.318614 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.318886 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.320322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:50.320630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:50.322093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:50.336038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 271/542] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:50.342357 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:50.449609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044edb7-5b1a-4c4a-af40-0c85df734a4a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:50.461631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:50.489208 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:50.494557 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567fee-f883-4f58-bb81-c46795a759ca None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:50.519862 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:50.520491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.520773 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.521054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.521789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=487a390503154187ab842e40b2a2fbbc) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:50.522098 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:50.524211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:50.530982 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f793bb-84ec-413f-9cdc-f6fe40284397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:50.531786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f793bb-84ec-413f-9cdc-f6fe40284397 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.532314 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f793bb-84ec-413f-9cdc-f6fe40284397 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.532705 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f793bb-84ec-413f-9cdc-f6fe40284397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.537206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 272/543] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:50 2022] GET /identity/v3/role_assignments?user.id=487a390503154187ab842e40b2a2fbbc&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:50.545103 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f793bb-84ec-413f-9cdc-f6fe40284397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-24f793bb-84ec-413f-9cdc-f6fe40284397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:50.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:50.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:50.552623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 272/544] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:50.560234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:50.702873 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86937-2eca-4baa-8683-dd4a4ab1b9c4 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.703221 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86937-2eca-4baa-8683-dd4a4ab1b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.703464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86937-2eca-4baa-8683-dd4a4ab1b9c4 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.705077 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 273/545] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:50.711306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e336f-a48f-4d77-9e8a-ae715713fc40 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.711668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e336f-a48f-4d77-9e8a-ae715713fc40 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.711894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e336f-a48f-4d77-9e8a-ae715713fc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.735309 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-255e336f-a48f-4d77-9e8a-ae715713fc40 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:50.735309 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-255e336f-a48f-4d77-9e8a-ae715713fc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:50.738124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d2d2d-78a5-4f1e-b46c-06c5d37bd925 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:50.793410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:50.794026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.794303 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.794573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.795271 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:50.795577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:50.796959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:50.806214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 273/546] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:50.812115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:50.818930 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 274/547] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:50.888028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:50.954665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21376394-4504-421f-9baf-9a8e1edb5717 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.000225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:51.000865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.001146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.001422 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.017188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:51.018670 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:51.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:51.037253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:51.039011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:51.039011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:51.039011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:51.039011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 274/548] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:51.046736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e336f-a48f-4d77-9e8a-ae715713fc40 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:51.128937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:51.171908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:51.173428 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e336f-a48f-4d77-9e8a-ae715713fc40 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.248173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:51.248924 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.249200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.249473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.252445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:51.252755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:51.254153 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:51.277488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 275/549] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:51.283133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:51.300642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:51.304699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954a8a1-7739-426e-adbc-71a03bc32928 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.369315 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:51.370082 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.370263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.370508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.399909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:51.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:51.406309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:51.407151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:51.411310 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 275/550] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:51.416071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:51.447575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dce6e-134c-43bb-bcdf-818290daf538 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.488231 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:51.510631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:51.511222 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.511502 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.511777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.532381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:51.533859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:51.553023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:51.555781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:46:51.557944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:51.562487 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ae465-c89f-4925-83d6-b9277221c07d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.562673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 276/551] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:51.567021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:51.599279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:51.600043 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.600358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.601219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.602044 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:51.602352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:51.603934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:51.613443 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 276/552] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:51.619202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:51.674626 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:51.754935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309751-9a8e-441f-83e4-fba94dce7b24 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.794073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe79992-d785-483b-8a62-3b2423dff9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:51.794983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79992-d785-483b-8a62-3b2423dff9df None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.795288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79992-d785-483b-8a62-3b2423dff9df None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.795967 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79992-d785-483b-8a62-3b2423dff9df None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.796992 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe79992-d785-483b-8a62-3b2423dff9df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:51.797300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe79992-d785-483b-8a62-3b2423dff9df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:51.798453 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30d1ab-6af0-4d38-bf84-bbc1d4e690c4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.798746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe79992-d785-483b-8a62-3b2423dff9df None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:51.827193 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 277/553] 10.222.0.58 () {56 vars in 1135 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:51.828749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003e03-05d6-410b-b33a-06c9c95e8a1a None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.829032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003e03-05d6-410b-b33a-06c9c95e8a1a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.829299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003e03-05d6-410b-b33a-06c9c95e8a1a None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.831621 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 278/554] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:51.832393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003e03-05d6-410b-b33a-06c9c95e8a1a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:51.847923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199133-0722-4e41-800b-0c456a081ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:51.848584 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199133-0722-4e41-800b-0c456a081ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.848867 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199133-0722-4e41-800b-0c456a081ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.849145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199133-0722-4e41-800b-0c456a081ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.863648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199133-0722-4e41-800b-0c456a081ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:51.866408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199133-0722-4e41-800b-0c456a081ad0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:51.885702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-e2199133-0722-4e41-800b-0c456a081ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:51.888999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:51.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:51.891050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:51.891050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:51.891050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:51.891050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 277/555] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:51.895121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f30f9a-7b25-499d-bf9d-deae6ffbcf47 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.895121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f30f9a-7b25-499d-bf9d-deae6ffbcf47 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.895121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f30f9a-7b25-499d-bf9d-deae6ffbcf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.917015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-29f30f9a-7b25-499d-bf9d-deae6ffbcf47 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:51.918487 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-29f30f9a-7b25-499d-bf9d-deae6ffbcf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:51.968058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003e03-05d6-410b-b33a-06c9c95e8a1a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:51.996070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 278/556] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:51.997093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f30f9a-7b25-499d-bf9d-deae6ffbcf47 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.001530 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.018805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.019459 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.019736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.020008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.149879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.151645 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.199116 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.249302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f30f9a-7b25-499d-bf9d-deae6ffbcf47 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.271610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 279/557] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:52.277334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.308854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ce8c-e339-4515-9493-45fbff4f3a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.309464 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ce8c-e339-4515-9493-45fbff4f3a13 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.309745 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ce8c-e339-4515-9493-45fbff4f3a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.310008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ce8c-e339-4515-9493-45fbff4f3a13 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.310648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ce8c-e339-4515-9493-45fbff4f3a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:52.310945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ce8c-e339-4515-9493-45fbff4f3a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.312359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ce8c-e339-4515-9493-45fbff4f3a13 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.325209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 279/558] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:52.329799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162916-d04f-4615-a45d-be5ba37a0942 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.330086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162916-d04f-4615-a45d-be5ba37a0942 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.330578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29162916-d04f-4615-a45d-be5ba37a0942 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.331768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 280/559] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:52.332593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162916-d04f-4615-a45d-be5ba37a0942 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.388305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2dde7-d75e-435e-b29b-ec179bee1546 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.418039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.426550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.427201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.427477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.427758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.436461 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.438809 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.440847 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:52.456494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:52.457492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:52.458441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:52.458441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:52.458441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:52.458441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 280/560] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:52.458441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.467037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29162916-d04f-4615-a45d-be5ba37a0942 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.503378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5f642-32a6-4122-bf82-92919864d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.504019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f642-32a6-4122-bf82-92919864d19a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.504302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f642-32a6-4122-bf82-92919864d19a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.504562 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5f642-32a6-4122-bf82-92919864d19a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.516694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5f642-32a6-4122-bf82-92919864d19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a0b5f642-32a6-4122-bf82-92919864d19a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:52.522025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:52.523888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 281/561] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:52.525269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e4f9-d8bd-48b8-aa48-1d65f52fd539 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.526122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e4f9-d8bd-48b8-aa48-1d65f52fd539 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.526122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e4f9-d8bd-48b8-aa48-1d65f52fd539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.545291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-5e88e4f9-d8bd-48b8-aa48-1d65f52fd539 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:52.546504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5e88e4f9-d8bd-48b8-aa48-1d65f52fd539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:52.578098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258208a-3516-49b5-a45f-fc775c80c43d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.617483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.623208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.623347 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 282/562] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:52.623454 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.623454 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.623608 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e4f9-d8bd-48b8-aa48-1d65f52fd539 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.634786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.636291 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:52.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:52.651066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:52.652325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 281/563] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:52.656700 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.688933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.719389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.738325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e4f9-d8bd-48b8-aa48-1d65f52fd539 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.775573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09401c-9731-4cc8-ab86-ad9e365e0d90 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.775973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.776778 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.777219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.777635 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.778423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:52.778880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.780417 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.793371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 283/564] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:52.794533 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.818517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.818823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.819788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.820195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.821029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:52.821339 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.822804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.832316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 282/565] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:52.833446 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.907064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c288-a7c3-4fdb-ae40-9c8055ee99f4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.922441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.942959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.943515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.943888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2844-5b12-4bfa-92c2-972730ce268e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.944029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.944269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.945000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:52.945298 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.946730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.957908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.965077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 284/566] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:52.965902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.979968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d6a30-6131-4fb3-8ddf-c6a65537926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.980594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6a30-6131-4fb3-8ddf-c6a65537926a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.980864 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6a30-6131-4fb3-8ddf-c6a65537926a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.981128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6a30-6131-4fb3-8ddf-c6a65537926a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.987766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d6a30-6131-4fb3-8ddf-c6a65537926a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.989653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d6a30-6131-4fb3-8ddf-c6a65537926a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-450d6a30-6131-4fb3-8ddf-c6a65537926a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:53.001166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:53.002133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:53.003037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:53.007137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 283/567] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:53.014312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49d6f7-953d-49a2-a67b-1890a10c6f89 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.014312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49d6f7-953d-49a2-a67b-1890a10c6f89 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.014312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49d6f7-953d-49a2-a67b-1890a10c6f89 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.014312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 284/568] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:53.014312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49d6f7-953d-49a2-a67b-1890a10c6f89 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.070568 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6d21b-0e0f-422a-a598-2cdf4b3f776e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.105090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.105721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.106003 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.106282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.117123 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.118624 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.119637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49d6f7-953d-49a2-a67b-1890a10c6f89 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:53.134267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:53.135486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:53.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:53.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:53.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:53.139239 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 285/569] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:53.140214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.153013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.153620 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.153889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.154156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.164782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:53.166194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:53.169946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:53.170888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:53.171777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 285/570] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:53.172483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.209159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.246605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3149a80-d436-438b-b027-eceddc899f91 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.276011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d6543-71f7-4717-8fdb-0b8d8376f415 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.281305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785fc48-d33e-451f-a7f9-25acbfd9f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.281935 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785fc48-d33e-451f-a7f9-25acbfd9f38d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.282216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785fc48-d33e-451f-a7f9-25acbfd9f38d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.282495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785fc48-d33e-451f-a7f9-25acbfd9f38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.293365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785fc48-d33e-451f-a7f9-25acbfd9f38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.294815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785fc48-d33e-451f-a7f9-25acbfd9f38d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-4785fc48-d33e-451f-a7f9-25acbfd9f38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:53.308793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:53.309923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:53.311124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:53.311124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:53.311124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:53.311335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.311335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.311335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.311335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.311667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:53.311667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.312843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.314654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 286/571] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:53.315724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecb21-5a75-4307-9e68-77c19fcb16af None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.316008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecb21-5a75-4307-9e68-77c19fcb16af None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.316291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ecb21-5a75-4307-9e68-77c19fcb16af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.325925 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 286/572] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:53.326745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.336831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-582ecb21-5a75-4307-9e68-77c19fcb16af None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:53.338040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-582ecb21-5a75-4307-9e68-77c19fcb16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:53.407960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 287/573] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:53.408906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecb21-5a75-4307-9e68-77c19fcb16af None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.418242 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.433436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.440826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf1d1e-f340-4639-b4e6-34c5e5d530f3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.477623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.478200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.478529 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.478810 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.479565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:53.479867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.481378 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.494123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 287/574] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:53.494940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.526430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ecb21-5a75-4307-9e68-77c19fcb16af None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.568191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.569505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.570130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.570718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.572410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:53.572872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.574489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.589683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 288/575] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:53.590797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.607261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ca20-289b-492c-9e96-fa864f5e5bb9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.644854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.645537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.645848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.646156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.646844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:53.647283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.649116 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.674094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 288/576] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:53.674094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.675961 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.690633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.713625 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb693-9918-46cc-91ed-8dc657bb2aec None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.748873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.749418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.749699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.749974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.750696 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71cc361c23f94761bec36dec15efe691) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:53.751002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.752472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.759061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 289/577] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/role_assignments?user.id=71cc361c23f94761bec36dec15efe691&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:53.759930 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.780643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36a7e2-629d-4bd2-b230-bbe627e26688 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.819165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.820194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.820481 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.820756 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] PATH_INFO: `/v3/users/glance` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.829542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.831042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:53.845659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:53.846899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 289/578] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:53.847886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.900525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3494-fa63-4a04-a8c4-bd2416803756 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.933358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.939744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.940086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.940728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.944492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.944492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.953725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.955221 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.967719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db77adf-71f1-4ba9-a932-cc8ce2978dad None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:53.971016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:53.972101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:53.973342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:53.973342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:53.973342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:53.973342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 290/579] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:53.973573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.007839 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.008527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.008807 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.009086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.016494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.017951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:54.031636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:54.039377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 290/580] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:54.040298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.099382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb81aab-46ba-41e7-9321-b6b825de17d6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.134850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.135784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.136055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.147025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:54.152928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:54.153856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:54.154717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 291/581] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:54.156009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.175378 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f732c69-d82f-4aa8-ae2d-c9df499949a4 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.204628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:54.212327 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.212955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.213299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.213624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.218624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:54.218624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.218624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.218624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:54.237834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 291/582] 10.222.0.58 () {56 vars in 1137 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:54.238723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.276187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e7166-6e94-4e47-9259-0bcd9031d2d1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.316020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.316647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.316927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.317201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.317972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:54.318337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.320068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.338658 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 292/583] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:54.338658 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.362350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5294128-3579-4b6d-83c8-f81ed2d078ef None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.404753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.405444 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.405799 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.406182 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.407528 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:54.407528 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.408730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.423970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 292/584] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:54.430130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.448027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9179c-c4dc-406a-bc31-2f0e79ae6a2e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.450562 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:54.488697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.489374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.489665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.489926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.490524 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:54.491769 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:54.492173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.493632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.502071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 293/585] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:54.502964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.549855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913792-3a7f-4314-b46e-3915316a2cb9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.587072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.587723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.588004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.588287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.599617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.601996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:54.619028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:54.620237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:54.621327 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:54.621327 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:54.621327 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:54.623061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 293/586] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:54.624052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.624254 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eede7a2-1285-4e45-bc87-e7e5beb6e985 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.669553 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.670210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.670578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.671014 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.679479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.681168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:54.693218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:54.695049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 294/587] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:54.696304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.734729 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:54.755772 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2319-39e1-4395-8242-8d8759a802fd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.760078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:54.793218 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.793886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.794158 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.794428 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/d1cdc7db1f714849ba14a987d2412591/roles/826c400ad3c34b06933206c5b981d0b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.810984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=d1cdc7db1f714849ba14a987d2412591, role_id=826c400ad3c34b06933206c5b981d0b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.812401 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.814408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5964f-a603-404e-bd55-1f4ef4e89b85 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:54.852103 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:54.852762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:54.853035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:54.853301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:54.866472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:54.868025 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:54.883546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:54.890246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:54.891540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:54.891540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:54.891540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:54.891540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 295/588] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:54.891540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.899585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 294/589] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:54 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/d1cdc7db1f714849ba14a987d2412591/roles/826c400ad3c34b06933206c5b981d0b0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:54.900721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:54.989008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.017275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057fb01-ffb4-45b8-af6c-18cedc9664b6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.061426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7f5ce-b545-4ca8-a702-d7121f6ab4ea None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.069660 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.070467 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.070746 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.071016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.071720 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:55.072022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.073400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.094539 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 296/590] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.094539 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.114364 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.115305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.115578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.116540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:55.116947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.118403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.138068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 295/591] 10.222.0.58 () {56 vars in 1137 bytes} [Sun Aug 28 00:46:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.139050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.183532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.224217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd23027-0772-430d-b8aa-ec6f4529c7e0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.263815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.264444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.264723 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.265014 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.265662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:55.265966 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.267500 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.275028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.276634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130b67-8939-4e39-bc33-ebb8e75abdd2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.286538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 297/592] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.287585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.320414 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.321498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.322078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.322554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.330957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.332991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:55.347872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:55.349049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:55.350122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:55.353309 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 296/593] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:55.354438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.406430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e01d51-772a-4233-b17b-fc42685fdaea None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.441957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.442634 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.442911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.443256 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.448779 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.455325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.456836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:55.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:55.473990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:55.474899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:55.474899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:55.474899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:55.474899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 298/594] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:55.475760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.478127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24408d-3db3-4bc8-b4be-de410bacaf0f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.515712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.516759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.517322 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.517824 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.527643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.528627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.530309 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:55.542286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:55.545624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:55.546597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 297/595] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:55.548072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.588257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c67b7-b9b1-4d8a-b285-7eb5794944b7 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.622910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.623183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.623457 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.623728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.624414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:55.624717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.626151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.639979 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 299/596] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.640728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.661460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce018-7053-4d15-82df-5bbbfe5eb032 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.697019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.711947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.712897 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.713380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.713836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.714684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:55.715002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.716418 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.729727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 298/597] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.730542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.747818 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3266eb-3c16-4a34-8007-4ba84178340d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.759248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.782984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78008f-8551-4791-9ca0-f12d0653e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.784113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78008f-8551-4791-9ca0-f12d0653e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.784393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78008f-8551-4791-9ca0-f12d0653e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.784663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78008f-8551-4791-9ca0-f12d0653e9c4 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.785383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78008f-8551-4791-9ca0-f12d0653e9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:55.785681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78008f-8551-4791-9ca0-f12d0653e9c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.787093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78008f-8551-4791-9ca0-f12d0653e9c4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.805284 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 300/598] 10.222.0.58 () {56 vars in 1139 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.806787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd146a-5932-41cc-8749-dba7ba063b89 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.807401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd146a-5932-41cc-8749-dba7ba063b89 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.807898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd146a-5932-41cc-8749-dba7ba063b89 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.809321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 301/599] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:55.810215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd146a-5932-41cc-8749-dba7ba063b89 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.855678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74075c4-2a21-4ab8-9439-c94ae671fb85 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.891728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb638bf8-acc5-424e-911f-436d81bd17f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.892379 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638bf8-acc5-424e-911f-436d81bd17f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.892655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638bf8-acc5-424e-911f-436d81bd17f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.893149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638bf8-acc5-424e-911f-436d81bd17f8 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/9bc80df87ba14b3595e171a0e8fd6f88/roles/826c400ad3c34b06933206c5b981d0b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.908677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb638bf8-acc5-424e-911f-436d81bd17f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=9bc80df87ba14b3595e171a0e8fd6f88, role_id=826c400ad3c34b06933206c5b981d0b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.910234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb638bf8-acc5-424e-911f-436d81bd17f8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.919281 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd146a-5932-41cc-8749-dba7ba063b89 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.952922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.953599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.953893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.954159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.961580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.963011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:55.974629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:55.975616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 302/600] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:55.976621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.996036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 299/601] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:55 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/9bc80df87ba14b3595e171a0e8fd6f88/roles/826c400ad3c34b06933206c5b981d0b0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:56.003980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4632095-9813-4f67-b2bb-4e1ecb019fe6 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.003980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4632095-9813-4f67-b2bb-4e1ecb019fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.003980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4632095-9813-4f67-b2bb-4e1ecb019fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.022834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b4632095-9813-4f67-b2bb-4e1ecb019fe6 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:56.024293 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b4632095-9813-4f67-b2bb-4e1ecb019fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:56.031713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.067408 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.109960 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 300/602] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:56.111283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4632095-9813-4f67-b2bb-4e1ecb019fe6 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.136476 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cc2b7-e38a-49f4-9f09-7f9629e06584 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.184698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.185879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.186475 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.186972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.204755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.207419 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:56.230115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:56.231402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:56.232318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:56.232318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:56.232318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:56.232788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 303/603] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:56.238877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.268619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4632095-9813-4f67-b2bb-4e1ecb019fe6 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.310544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.311205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.311542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.311822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.312539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:56.312848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.314780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.328719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 301/604] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:56.335488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.361410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.371503 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.390132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e90cd9-9591-438c-9f39-f5215b49b337 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.450701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.452816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.453270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.454418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.455241 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:56.456348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.458467 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.472964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2fd1c-dad1-4522-97e0-81fdf3c1c55b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.487967 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 304/605] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:56.489071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.525184 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.525849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.526125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.526402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/c481bcb02495453f806fdc6a9d30ed58/roles/826c400ad3c34b06933206c5b981d0b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.546193 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=c481bcb02495453f806fdc6a9d30ed58, role_id=826c400ad3c34b06933206c5b981d0b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.547714 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.601964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69bf93-a815-4185-88a0-43963d36a99b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.637701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.638250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.638524 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.638792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.656153 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.663126 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 302/606] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:56 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/c481bcb02495453f806fdc6a9d30ed58/roles/826c400ad3c34b06933206c5b981d0b0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:46:56.663126 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.674862 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:56.680846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:56.682501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:56.684029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 305/607] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:56.693305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.866314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8650-b9b9-4df1-83f8-125842324fb3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.876191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.898058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01714862-3a2d-4c2a-bccb-04303777f2bd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.916119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.916891 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.917240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.917643 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.918384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:56.918861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.922288 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.933584 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 306/608] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:56.938930 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.948275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4d1dc-637c-463e-b263-d301d88807fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.949164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4d1dc-637c-463e-b263-d301d88807fa None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.949435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4d1dc-637c-463e-b263-d301d88807fa None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.949711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4d1dc-637c-463e-b263-d301d88807fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.957671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4d1dc-637c-463e-b263-d301d88807fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.959308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4d1dc-637c-463e-b263-d301d88807fa None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-31e4d1dc-637c-463e-b263-d301d88807fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:56.974625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:56.975840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:56.976780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 303/609] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:56.977537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfbd7-0aa5-486e-b525-b5c5efa6c7e7 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.977822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfbd7-0aa5-486e-b525-b5c5efa6c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.978092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdfbd7-0aa5-486e-b525-b5c5efa6c7e7 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.980189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 304/610] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:56.982745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdfbd7-0aa5-486e-b525-b5c5efa6c7e7 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:57.019629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:57.075517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4016a-eb1a-4302-b33d-42a6c9eb7aaa None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:57.102084 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdfbd7-0aa5-486e-b525-b5c5efa6c7e7 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:57.119847 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c66d6-11ff-48b7-88a4-35e7c2899b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:57.121089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c66d6-11ff-48b7-88a4-35e7c2899b63 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.121512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c66d6-11ff-48b7-88a4-35e7c2899b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.121982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c66d6-11ff-48b7-88a4-35e7c2899b63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.138001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c66d6-11ff-48b7-88a4-35e7c2899b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:57.139608 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c66d6-11ff-48b7-88a4-35e7c2899b63 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:57.142935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:57.143767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.144186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.144622 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.145478 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:57.145923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:57.148890 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9d1c66d6-11ff-48b7-88a4-35e7c2899b63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:57.156393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:57.157580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:57.158687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:57.158687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:57.158687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:57.163141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 307/611] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:57.163141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f106bd-a542-4c44-bb94-e1dac3261794 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.163141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f106bd-a542-4c44-bb94-e1dac3261794 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.163141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f106bd-a542-4c44-bb94-e1dac3261794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.173830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 305/612] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:57.175007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:57.181857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-00f106bd-a542-4c44-bb94-e1dac3261794 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:57.183207 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-00f106bd-a542-4c44-bb94-e1dac3261794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:57.211533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:57.283199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 308/613] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:57.284196 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f106bd-a542-4c44-bb94-e1dac3261794 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:57.301252 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146f842-8c77-451f-8f96-173904ea9b4c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:57.352776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:57.353431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.353665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.353905 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.354753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:57.355057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:57.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:57.377672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:57.382311 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 306/614] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:57.389279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:57.491881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f106bd-a542-4c44-bb94-e1dac3261794 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:57.503297 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:57.562960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:57.563650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.563924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.564192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/487a390503154187ab842e40b2a2fbbc/roles/826c400ad3c34b06933206c5b981d0b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.583225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794fe9-cca2-495c-9084-ab082a93377b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:57.593117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=487a390503154187ab842e40b2a2fbbc, role_id=826c400ad3c34b06933206c5b981d0b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:57.594617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:57.627122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:57.627753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.628027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.628294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.636442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:57.637877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:57.650854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:57.651986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 307/615] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:57.652962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:57.680064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 309/616] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:57 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/487a390503154187ab842e40b2a2fbbc/roles/826c400ad3c34b06933206c5b981d0b0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:57.681167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:57.780890 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b213b-a82f-4941-ae9f-e39dc4cdfa6e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:57.801408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:57.808215 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:57.811584 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e270-d006-41b7-a893-2469fa8b7e76 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:57.819620 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:57.820250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.820572 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.820845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.832858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:57.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:57.848046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:57.849087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 308/617] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:57.856248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:57.876333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:57.877103 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:57.877316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:57.877675 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:57.879312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:57.879312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:57.880999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:57.928805 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 310/618] 10.222.0.58 () {56 vars in 1135 bytes} [Sun Aug 28 00:46:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:57.933960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.032123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faed72-736e-42cc-9d5f-0b96a22c6f07 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.070317 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.070979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.071284 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.071598 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.072272 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:58.072568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.073925 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.083079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 309/619] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:58.089289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.136050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56427a51-4031-4c71-81a0-a114d5326f08 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.171604 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.200055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.200702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.200976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.201245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.224063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.226215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.233050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d531d-b95f-4d5c-830b-45175fb19d33 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:58.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:58.251217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:58.252378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:58.252378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:58.252378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:58.252378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 311/620] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:58.258580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.266469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.273753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.274808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.275293 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.275725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.287275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.289068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:58.306904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:58.307973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:58.308927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:58.308927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:58.308927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:58.315712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 310/621] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:58.322702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.456402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400307c-9fa3-4f08-8dbe-4a19169540bc None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.487158 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.494933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1ff8-f64a-49f2-b5f5-e16b7f99fd32 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.501407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010344e-5ffe-4fdf-8dd2-9bb30d8e5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.502171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010344e-5ffe-4fdf-8dd2-9bb30d8e5af1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.502449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010344e-5ffe-4fdf-8dd2-9bb30d8e5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.502716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010344e-5ffe-4fdf-8dd2-9bb30d8e5af1 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.503462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010344e-5ffe-4fdf-8dd2-9bb30d8e5af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:58.503760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010344e-5ffe-4fdf-8dd2-9bb30d8e5af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.505192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010344e-5ffe-4fdf-8dd2-9bb30d8e5af1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.522787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 312/622] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:58.524346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f1d60-6192-4dd1-ae76-2a3c180ae5b6 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.525964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f1d60-6192-4dd1-ae76-2a3c180ae5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.526387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f1d60-6192-4dd1-ae76-2a3c180ae5b6 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.527821 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 313/623] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:58.529480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f1d60-6192-4dd1-ae76-2a3c180ae5b6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.549370 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959ec92-5d27-481f-a87b-c97be1aa3ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.549920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ec92-5d27-481f-a87b-c97be1aa3ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.550434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ec92-5d27-481f-a87b-c97be1aa3ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.550710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ec92-5d27-481f-a87b-c97be1aa3ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.551394 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959ec92-5d27-481f-a87b-c97be1aa3ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:58.551696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959ec92-5d27-481f-a87b-c97be1aa3ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.554447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959ec92-5d27-481f-a87b-c97be1aa3ba8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.571659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 311/624] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:58.573409 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffb75c-abc8-4d07-a65f-3b2ec839d904 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.573915 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffb75c-abc8-4d07-a65f-3b2ec839d904 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.574419 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffb75c-abc8-4d07-a65f-3b2ec839d904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.592875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c4ffb75c-abc8-4d07-a65f-3b2ec839d904 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:58.594446 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c4ffb75c-abc8-4d07-a65f-3b2ec839d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:58.612359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.665437 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f1d60-6192-4dd1-ae76-2a3c180ae5b6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.669089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 312/625] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:58.670136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffb75c-abc8-4d07-a65f-3b2ec839d904 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.734752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.735810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.741382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.741942 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.753044 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.755270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:58.777020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:58.777994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:58.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:58.783035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 314/626] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:58.790453 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.836546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.875413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffb75c-abc8-4d07-a65f-3b2ec839d904 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.927138 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822f6c7-2cc4-4da5-a378-120ea56085f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.927715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47108ee-85f4-41db-8a62-3b1d6b7cf361 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.928461 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f6c7-2cc4-4da5-a378-120ea56085f8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.929031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f6c7-2cc4-4da5-a378-120ea56085f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.929301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f6c7-2cc4-4da5-a378-120ea56085f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.939089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822f6c7-2cc4-4da5-a378-120ea56085f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.939519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822f6c7-2cc4-4da5-a378-120ea56085f8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-4822f6c7-2cc4-4da5-a378-120ea56085f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:58.951948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:58.953292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:58.954365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:58.958609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 313/627] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:58.961575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.961854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff1d8-ba7e-4710-a917-031a2ca2f0c0 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.962451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff1d8-ba7e-4710-a917-031a2ca2f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.962952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff1d8-ba7e-4710-a917-031a2ca2f0c0 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.968994 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 314/628] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:58.969814 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff1d8-ba7e-4710-a917-031a2ca2f0c0 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.976874 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a77df-2e92-48ce-9fb7-05ddd93ba4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.977724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a77df-2e92-48ce-9fb7-05ddd93ba4cc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.978152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a77df-2e92-48ce-9fb7-05ddd93ba4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.978607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a77df-2e92-48ce-9fb7-05ddd93ba4cc None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.979507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a77df-2e92-48ce-9fb7-05ddd93ba4cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:58.979972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a77df-2e92-48ce-9fb7-05ddd93ba4cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.982563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a77df-2e92-48ce-9fb7-05ddd93ba4cc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:58.999200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 315/629] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:59.000680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22702d-183f-4bfc-aed2-64caa2f4d79a None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.001112 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22702d-183f-4bfc-aed2-64caa2f4d79a None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.001533 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22702d-183f-4bfc-aed2-64caa2f4d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.020713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-7f22702d-183f-4bfc-aed2-64caa2f4d79a None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:59.022487 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-7f22702d-183f-4bfc-aed2-64caa2f4d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:59.090081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff1d8-ba7e-4710-a917-031a2ca2f0c0 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.099416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 316/630] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:46:59.101204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22702d-183f-4bfc-aed2-64caa2f4d79a None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.136119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772d84e-406e-483d-b546-70d47077747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.137080 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772d84e-406e-483d-b546-70d47077747a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.137429 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772d84e-406e-483d-b546-70d47077747a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.137773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772d84e-406e-483d-b546-70d47077747a None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.139017 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772d84e-406e-483d-b546-70d47077747a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:59.139610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772d84e-406e-483d-b546-70d47077747a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:59.141786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772d84e-406e-483d-b546-70d47077747a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.165739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 315/631] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:59.166824 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772d84e-406e-483d-b546-70d47077747a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.171540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.230846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22702d-183f-4bfc-aed2-64caa2f4d79a None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.253423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.274927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.275903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.276355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.276796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.288452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772d84e-406e-483d-b546-70d47077747a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.289068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:59.294217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:59.295255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:59.296345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:59.303307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 317/632] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:59.304461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.327174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.327770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.328048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.328320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/71cc361c23f94761bec36dec15efe691/roles/826c400ad3c34b06933206c5b981d0b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=71cc361c23f94761bec36dec15efe691, role_id=826c400ad3c34b06933206c5b981d0b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:59.347240 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.412219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847836e5-c3fb-4a8c-aaa5-6a939531958b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.417818 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 316/633] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:59 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/71cc361c23f94761bec36dec15efe691/roles/826c400ad3c34b06933206c5b981d0b0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:59.419004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.453059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.453681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.453962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.454236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.504510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.508255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.535613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:59.537219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.574873 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a441-ba73-4a3c-94a4-66b0546ded64 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.632675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.633195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.633469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.633733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.634653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:59.634956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:59.637208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.648287 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 317/634] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:59.649491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.659955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 318/635] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:46:59.661059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.746253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.780154 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d660-ea91-4f8b-9199-6d177258fb47 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.785482 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebfbef-abbe-4375-8916-a496d480f586 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.807330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.821266 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.822063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.822386 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.822729 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.831479 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.832837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.833286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.834161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.836369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:59.838182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.849147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:59.855788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:59.856938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:46:59.857971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:59.858765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:59.859881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:59.860970 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:59.860970 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:59.860970 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:46:59.861585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 319/636] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:59.862557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.863224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 318/637] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:59.867880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.980577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834c279-9e29-4962-a1d3-1e3f325bab8d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.001325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654313b-954f-45ca-ae70-75560960e30f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.008921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.018824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.019914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.020481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.020754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.034747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.036257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.039547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d3bab-6b47-4fd5-97e3-1f19dcdaf1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.040167 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3bab-6b47-4fd5-97e3-1f19dcdaf1de None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.040485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3bab-6b47-4fd5-97e3-1f19dcdaf1de None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.040767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3bab-6b47-4fd5-97e3-1f19dcdaf1de None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.041430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d3bab-6b47-4fd5-97e3-1f19dcdaf1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:00.041733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d3bab-6b47-4fd5-97e3-1f19dcdaf1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.043199 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d3bab-6b47-4fd5-97e3-1f19dcdaf1de None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:00.052632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:00.053790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:00.054726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:00.054726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:00.054726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:00.054726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 320/638] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:00.054955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.058087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 319/639] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:00.059575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee0f8-1b46-4f93-86a1-9a229d72dd05 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.059857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee0f8-1b46-4f93-86a1-9a229d72dd05 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.060126 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee0f8-1b46-4f93-86a1-9a229d72dd05 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.061497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 320/640] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:00.063904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ee0f8-1b46-4f93-86a1-9a229d72dd05 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.177029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ee0f8-1b46-4f93-86a1-9a229d72dd05 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.178620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ba62-18ae-418f-a22c-70a33c0ec282 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.214522 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.215152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.215441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.215705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.216754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:00.217059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.218441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.222434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae74bf2-44c0-4e7e-8c69-a6ffa470918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.223285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74bf2-44c0-4e7e-8c69-a6ffa470918c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.224270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74bf2-44c0-4e7e-8c69-a6ffa470918c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.224688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74bf2-44c0-4e7e-8c69-a6ffa470918c None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.226415 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae74bf2-44c0-4e7e-8c69-a6ffa470918c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:00.226883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae74bf2-44c0-4e7e-8c69-a6ffa470918c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.227657 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 321/641] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:00.228489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.228783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae74bf2-44c0-4e7e-8c69-a6ffa470918c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.246534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 321/642] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:00.248614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ec40-33ad-4662-b967-9e6fec27a154 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.249034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ec40-33ad-4662-b967-9e6fec27a154 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.249708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ec40-33ad-4662-b967-9e6fec27a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.272358 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-f519ec40-33ad-4662-b967-9e6fec27a154 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:00.274325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-f519ec40-33ad-4662-b967-9e6fec27a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:00.276049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.337465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a137377-08ea-45a6-84a0-ad7a70522725 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.355149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 322/643] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:00.355149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519ec40-33ad-4662-b967-9e6fec27a154 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.379662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.380390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.380702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.380966 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.390249 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.391780 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.392301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:00.406700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:00.410565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 322/644] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:00.411601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.494155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519ec40-33ad-4662-b967-9e6fec27a154 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.530538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.531188 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.531443 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.531718 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.538597 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.543224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.544361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ad2ac-feb1-444f-94ac-995cda8b29d0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.544673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:00.560744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:00.576921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:00.578011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:00.578011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:00.578011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:00.578011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 323/645] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:00.578011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.592130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.593670 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.594265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.594777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.606012 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.608074 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:00.626399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:00.627560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:00.628703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:00.631612 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 323/646] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:00.632690 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.674536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.697595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6c9d6-2719-4c37-83d1-ee4c999ed6f9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.735143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.735750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.736025 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.736298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.737031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:00.737329 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.739156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.753925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86422457-9a38-4857-85e1-35c968fe0945 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.759763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 324/647] 10.222.0.58 () {56 vars in 1137 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:00.760599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.796067 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.796998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.797275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.797551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.798193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:00.798489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.799872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.813308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 324/648] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:00.813987 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.840977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.880063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcf2ea-94b4-42b0-a29d-1f5c6c7620df None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.921071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.921693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.921968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.922234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.923484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2604688-fe65-4561-89c7-3bbb3bbd5c18 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:00.925205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:00.933204 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:00.937977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:00.938916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 325/649] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:00.940659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:00.965756 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:00.966622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:00.966895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:00.967218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:00.967902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:00.968438 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:00.969607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:00.981365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 325/650] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:00.982100 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.064145 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8759d3-46e4-4511-94f2-516887361b7e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.074994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.097050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c60bf-ac71-4159-b832-f74871647a45 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.102384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.103003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.103312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.103589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.136269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.137096 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.137307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.137548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.147350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.149096 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:01.163160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:01.164398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 326/651] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:01.165383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.180484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.188337 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.189965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.291630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea395-c87a-4666-9ee8-4f9c35dd2a43 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.300942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 326/652] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:47:01.300942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.330297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.330875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.331109 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.331389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.332104 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:01.332345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.333711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.342962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 327/653] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:01.342962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.350690 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.407800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.414838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1835c0-e79a-495f-a476-71568bb0321e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.454006 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.454616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.454896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.455190 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.455968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=d1cdc7db1f714849ba14a987d2412591) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:01.456276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.457696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.458328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d6f36-75f3-4ab3-800e-101270966c7d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.471509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 327/654] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/role_assignments?user.id=d1cdc7db1f714849ba14a987d2412591&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:01.471509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.506768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.507416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.507689 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.507957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.508696 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:01.508996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.510454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.530594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 328/655] 10.222.0.58 () {56 vars in 1137 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:01.531587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.594248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c5cff-bc30-45d1-bc21-3f174334ac3e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.623955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.635282 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247077eb-9ad5-46f2-80a5-704672ad7c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.635932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247077eb-9ad5-46f2-80a5-704672ad7c2e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.643426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247077eb-9ad5-46f2-80a5-704672ad7c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.643426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247077eb-9ad5-46f2-80a5-704672ad7c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.648305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247077eb-9ad5-46f2-80a5-704672ad7c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.649801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247077eb-9ad5-46f2-80a5-704672ad7c2e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-247077eb-9ad5-46f2-80a5-704672ad7c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:01.666653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:01.670467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 328/656] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cfd55-94a3-46ff-b67e-b03df5f8dfe1 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cfd55-94a3-46ff-b67e-b03df5f8dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cfd55-94a3-46ff-b67e-b03df5f8dfe1 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 329/657] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:01.676725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cfd55-94a3-46ff-b67e-b03df5f8dfe1 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.694860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc710e36-9a04-4a99-a5d3-84dbc041cb8f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.697263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.738884 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.739554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.739831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.740101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.752565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.754038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:01.769345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:01.770356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:01.771321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:01.771321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:01.771321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:01.771321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 329/658] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:01.771552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.806620 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cfd55-94a3-46ff-b67e-b03df5f8dfe1 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.844076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.845018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.845457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.845733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.886215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05668-9ff1-482a-986c-368f0db562d8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.900165 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.921716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c783ad-5833-48cc-8471-d59da34c0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.922328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c783ad-5833-48cc-8471-d59da34c0aed None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.922605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c783ad-5833-48cc-8471-d59da34c0aed None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.922878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c783ad-5833-48cc-8471-d59da34c0aed None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.923548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c783ad-5833-48cc-8471-d59da34c0aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:01.923853 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c783ad-5833-48cc-8471-d59da34c0aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.925264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c783ad-5833-48cc-8471-d59da34c0aed None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.925848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.927547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.941702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 330/659] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:01.941702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c49b-463d-4065-9c6d-0eeb6f74b6e2 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.941702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c49b-463d-4065-9c6d-0eeb6f74b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.942015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c49b-463d-4065-9c6d-0eeb6f74b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.943370 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.962128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-5b99c49b-463d-4065-9c6d-0eeb6f74b6e2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:01.963384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5b99c49b-463d-4065-9c6d-0eeb6f74b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:02.055127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 331/660] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:02.055127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99c49b-463d-4065-9c6d-0eeb6f74b6e2 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.055391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 330/661] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:47:02.055391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.164059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99c49b-463d-4065-9c6d-0eeb6f74b6e2 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.165969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:02.183137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500630f4-5c73-42b3-b786-53295b71777c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.198728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:02.209726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.210345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.210777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.211067 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.211810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:02.212490 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.214116 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.225536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.226708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.227226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.227648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.229440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 332/662] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:02.230526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.239533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.241898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:02.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:02.259691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:02.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:02.263168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 331/663] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:02.264294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.360279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cce48-4f52-4471-a1c1-d631b48d7bd0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.403114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.404187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.404654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.405117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.406485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d580dc-e79b-4777-a36b-01791ecb50f3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.418248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.420302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:02.436545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:02.437641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:02.438548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:02.438548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:02.438548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:02.438548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 333/664] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:02.438548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.449326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.450175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.450469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.450733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.457870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:02.458016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.460104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:02.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:02.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:02.474360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 332/665] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:02.481712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.509113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:02.554730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7814-1c07-477b-8116-cc8240180a79 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.586767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649daec-e978-4757-b8de-2f39cfae58d2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.589017 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.589633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.589903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.590177 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.590856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:02.591433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.592865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.605682 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 334/666] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:02.606528 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.630653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73106-f69e-49ca-b315-02522530248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.631367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73106-f69e-49ca-b315-02522530248a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.631622 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73106-f69e-49ca-b315-02522530248a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.631888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73106-f69e-49ca-b315-02522530248a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.644425 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a73106-f69e-49ca-b315-02522530248a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-16a73106-f69e-49ca-b315-02522530248a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:02.650594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:02.651674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:02.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:02.656919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 333/667] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:02.657738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73106-f69e-49ca-b315-02522530248a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.713365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:02.749003 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9566b7-0e55-4c2f-8417-3998092b380b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.790184 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:02.803878 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73106-f69e-49ca-b315-02522530248a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.806605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.807585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.807973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.808424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.809468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:02.809971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.812307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.835134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 335/668] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:02.835134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.856080 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.856684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.857073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.857342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.858064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:02.858366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.859806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.882172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 334/669] 10.222.0.58 () {56 vars in 1139 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:02.882172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:02.947561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5644-28b7-451e-85bc-51b6446aa834 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.983828 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1e1b1-6d83-4c26-afbb-2e794d3034fd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:02.988007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:02.988648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:02.988888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:02.989156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:02.989880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=9bc80df87ba14b3595e171a0e8fd6f88) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:02.990185 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:02.992023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:02.993784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.003914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 336/670] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/role_assignments?user.id=9bc80df87ba14b3595e171a0e8fd6f88&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:03.003914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.046135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.047311 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.047737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.048155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:03.049819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.052516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 335/671] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:03.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.093126 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.160442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67615c02-01e7-45b2-a37b-5b8e32d47714 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:03.209024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e911-0abf-4cfe-bab2-fc3f759a1f59 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:03.210725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.211290 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.211564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.211834 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.220763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.222234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:03.235182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:03.238053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 337/672] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:03.240160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.261479 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.262619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.263173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.263348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.315821 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.352189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.354268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.356108 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aed082-7d5c-4126-b0a2-63e8abcf0997 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:03.372061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.399091 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.399761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.400039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.400308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.413868 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.415642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:03.438432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:03.439749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:03.440688 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:03.440688 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:03.440688 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:03.445789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 338/673] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:03.446830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.478851 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 336/674] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:47:03.479734 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.565636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15c569-bf4f-474c-855d-a81180763d4a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:03.576765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.592896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f664-82ed-44d6-b7d1-1547169f3af3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:03.603154 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.603771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.604516 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.604516 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.605026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:03.605844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.607346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.608755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.625846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 339/675] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:03.625846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.636065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef801b-c118-43f3-ae2a-4a7abffcae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.636736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef801b-c118-43f3-ae2a-4a7abffcae00 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.636939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef801b-c118-43f3-ae2a-4a7abffcae00 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.637205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef801b-c118-43f3-ae2a-4a7abffcae00 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.637859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef801b-c118-43f3-ae2a-4a7abffcae00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:03.638161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef801b-c118-43f3-ae2a-4a7abffcae00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef801b-c118-43f3-ae2a-4a7abffcae00 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.653094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 337/676] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:03.654701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ea05-4f36-49e7-aba2-395e41eb8593 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.655201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ea05-4f36-49e7-aba2-395e41eb8593 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.655640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ea05-4f36-49e7-aba2-395e41eb8593 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.657619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 338/677] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:03.658621 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9ea05-4f36-49e7-aba2-395e41eb8593 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.747296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7714-3a42-4520-a1cc-ac2a767edafb None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:03.771270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9ea05-4f36-49e7-aba2-395e41eb8593 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:03.789645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e653-7f2f-47a7-b01b-5ed82111b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.790551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e653-7f2f-47a7-b01b-5ed82111b946 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.790969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e653-7f2f-47a7-b01b-5ed82111b946 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.791420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e653-7f2f-47a7-b01b-5ed82111b946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.802670 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e653-7f2f-47a7-b01b-5ed82111b946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.804969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e653-7f2f-47a7-b01b-5ed82111b946 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.808653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:03.809311 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.809580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.809866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.810595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=c481bcb02495453f806fdc6a9d30ed58) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:03.810896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:03.812352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:03.819138 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 339/678] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/role_assignments?user.id=c481bcb02495453f806fdc6a9d30ed58&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:03.819928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-e5a4e653-7f2f-47a7-b01b-5ed82111b946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:03.822714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:03.823698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:03.824616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:03.824616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:03.824616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:03.824616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 340/679] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:03.825498 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f332e-cde8-4935-b190-8c112140a165 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.825776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f332e-cde8-4935-b190-8c112140a165 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.826045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f332e-cde8-4935-b190-8c112140a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.847158 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-f50f332e-cde8-4935-b190-8c112140a165 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:03.848392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-f50f332e-cde8-4935-b190-8c112140a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:03.872760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.892280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:03.967677 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 341/680] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:03.969395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f332e-cde8-4935-b190-8c112140a165 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:03.971427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0f990-7fc7-4b22-9fdf-0f433f4a34b1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.015554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.016270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.016662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.017039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.028917 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.031385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:04.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:04.049326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:04.050631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:04.052636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 340/681] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:04.058985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.138163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f332e-cde8-4935-b190-8c112140a165 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.184215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.184923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.185208 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.185474 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.186257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:04.186519 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.188944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.189799 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:04.196790 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247b296-7cd6-4c0e-ab1f-c0f2d3a894ea None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.205735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 342/682] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:04.212029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.232045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:04.242860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.243505 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.243858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.244438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.245187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:04.245490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.247358 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.268758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 341/683] 10.222.0.58 () {56 vars in 1135 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:04.274626 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.345215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974fa5a-1c5b-4235-b00d-5dffdc9c4607 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.381554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.382378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.382754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.383031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.387570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ce37-8072-4008-94b8-ff2c68e8851b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.390601 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.392085 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:04.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:04.406111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:04.407023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 343/684] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:04.408065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.435575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.436638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.436930 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.437209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.471828 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:04.489963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:04.525983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d98a4f-8271-4041-8709-6c3bee346ac4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.532575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.534544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.570607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.571658 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.572182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.572599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.584604 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:04.591030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:04.592489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:04.593483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:04.595971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 344/685] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:04.597161 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.670047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 342/686] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:47:04.670047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.745535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:04.749638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5d7e-ce96-4dd7-a976-b62907535333 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.796664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:04.803628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.808687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.808687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.808687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.808687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:04.808687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.809131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cdede-c25d-4be0-b264-e7076427255e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.809226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.831371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 345/687] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:04.831371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.857417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.858048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.858314 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.858736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.859891 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:04.860197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.862040 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.875177 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 343/688] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:04.876306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.965578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b90820-0706-49a1-a92a-8d33366d34ba None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.012116 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1311bf-b1e5-449c-9dbc-2adab6c92689 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.013012 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.014122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.014573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.015587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.029681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.032277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.033365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:05.054090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:05.055302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:05.056525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:05.056525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:05.056525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:05.056702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.056702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.056702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.056702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.056991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=487a390503154187ab842e40b2a2fbbc) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:05.056991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.058278 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.058596 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 346/689] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:05.059605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:05.067166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 344/690] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/role_assignments?user.id=487a390503154187ab842e40b2a2fbbc&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:05.067166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:05.167192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:05.251293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e02bc9-02e4-431f-81eb-929c4bb19137 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.255128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa8351-b354-40bc-a882-481e73c81d85 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.299877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.299877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.300181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.300394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.311907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43b5bb-2bd0-4a1f-8fb5-a3e9227cb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.312449 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43b5bb-2bd0-4a1f-8fb5-a3e9227cb368 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.312729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43b5bb-2bd0-4a1f-8fb5-a3e9227cb368 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.313003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43b5bb-2bd0-4a1f-8fb5-a3e9227cb368 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.313653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43b5bb-2bd0-4a1f-8fb5-a3e9227cb368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:05.313750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.313958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43b5bb-2bd0-4a1f-8fb5-a3e9227cb368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.315479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.315589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43b5bb-2bd0-4a1f-8fb5-a3e9227cb368 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.329900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 345/691] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:05.330972 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1cde-fa67-4cb0-b5ab-a833cdf48bac None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.331404 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1cde-fa67-4cb0-b5ab-a833cdf48bac None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.331581 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1cde-fa67-4cb0-b5ab-a833cdf48bac None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:05.332023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:05.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:05.334002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:05.334002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:05.334002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:05.334213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 346/692] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:05.334284 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 347/693] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:05.338451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62403751-b74a-4913-8c87-9060de11b554 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.338738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62403751-b74a-4913-8c87-9060de11b554 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.338857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:05.339016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62403751-b74a-4913-8c87-9060de11b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.364187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-62403751-b74a-4913-8c87-9060de11b554 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:05.369183 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-62403751-b74a-4913-8c87-9060de11b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:05.402642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:05.437255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 347/694] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:05.438147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62403751-b74a-4913-8c87-9060de11b554 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:05.450738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:05.463172 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61da54-7f46-4d9d-922d-056e80b4e6c0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.527653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.528294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.528577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.531423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.546915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.550172 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:05.570783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:05.571764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:05.572680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 348/695] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:05.580967 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:05.624838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62403751-b74a-4913-8c87-9060de11b554 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.729565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.730967 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.731423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.732869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.733707 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:05.735441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.737043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.753250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be23d-ad3c-4f72-a44c-a7d301eff6b0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.774885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 348/696] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:05.775786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:05.797400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.798285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.798722 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.799204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.800062 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:05.800532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.802119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.813531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:05.818055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 349/697] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:05.819961 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:05.846687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:05.917582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0013aa-48af-4228-a5f6-716ed76ca6f6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.960406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:05.961568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:05.961849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:05.962119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:05.975750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:05.977614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:05.981573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1ac0-b431-4b70-845f-0638ed6957db None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:05.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:05.995644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:05.997648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:05.997648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:05.997648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:05.997648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 349/698] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:05.997648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.041724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.042983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.043663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.044270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.056119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.058647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:06.085065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:06.086914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:06.088878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:06.099906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 350/699] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:06.099906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.106886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.127816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c82e4-b3af-4cb3-ac6d-a37d7caa56e9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:06.166550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.167635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.168102 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.168602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.169513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71cc361c23f94761bec36dec15efe691) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:06.170011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.171788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.178697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 350/700] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:05 2022] GET /identity/v3/role_assignments?user.id=71cc361c23f94761bec36dec15efe691&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:06.179830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.184895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.211838 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be892b-c6d5-46f5-9dc6-09e2c035d139 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:06.254156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51035c6-54ff-4a38-a70b-e019b3ebd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.254822 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51035c6-54ff-4a38-a70b-e019b3ebd0ab None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.255122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51035c6-54ff-4a38-a70b-e019b3ebd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.255400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51035c6-54ff-4a38-a70b-e019b3ebd0ab None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.256426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51035c6-54ff-4a38-a70b-e019b3ebd0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:06.256820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51035c6-54ff-4a38-a70b-e019b3ebd0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.258274 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51035c6-54ff-4a38-a70b-e019b3ebd0ab None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.276080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 351/701] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:06.277839 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e285-8676-4a5e-b4db-4ecff2eb77a0 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.278120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e285-8676-4a5e-b4db-4ecff2eb77a0 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.278392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e285-8676-4a5e-b4db-4ecff2eb77a0 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.280653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 352/702] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:06.281442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e285-8676-4a5e-b4db-4ecff2eb77a0 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.315028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ebd4-fdb6-4064-b982-025bb4b69c64 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:06.362608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194a53f-601a-4a24-80ac-1b65eef377c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.363995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194a53f-601a-4a24-80ac-1b65eef377c0 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.363995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194a53f-601a-4a24-80ac-1b65eef377c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.364302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194a53f-601a-4a24-80ac-1b65eef377c0 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.365123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194a53f-601a-4a24-80ac-1b65eef377c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:06.365928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194a53f-601a-4a24-80ac-1b65eef377c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.368092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194a53f-601a-4a24-80ac-1b65eef377c0 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.388551 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 351/703] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:47:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:06.389736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004b325-4d5e-4b44-849e-a4cc0d67381f None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.390023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004b325-4d5e-4b44-849e-a4cc0d67381f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.390292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004b325-4d5e-4b44-849e-a4cc0d67381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.407958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.421219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c004b325-4d5e-4b44-849e-a4cc0d67381f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:06.422291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e285-8676-4a5e-b4db-4ecff2eb77a0 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:06.422516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c004b325-4d5e-4b44-849e-a4cc0d67381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:06.469132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.470139 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.470506 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.470875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.471599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.473111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.482976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.508476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 352/704] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:06.509409 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004b325-4d5e-4b44-849e-a4cc0d67381f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.611931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 353/705] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:47:06 2022] POST /identity/v3/users => generated 254 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:06.641622 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004b325-4d5e-4b44-849e-a4cc0d67381f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:06.683501 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.684123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.684500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.684779 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.693923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.792274 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.793737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.822220 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.941004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 353/706] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:47:06.947667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.971803 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdd50f-c516-4da0-ab24-256a20670c4f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.001442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:07.025403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:07.026471 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.027576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.027576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.028549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:07.030571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:07.050024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:07.051353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:07.052504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 354/707] 10.222.0.58 () {56 vars in 1129 bytes} [Sun Aug 28 00:47:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:07.060869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:07.093818 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56ed26-652f-4a41-9a23-43a599a64e17 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.144285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:07.145752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.147476 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:07.147891 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.148544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.174513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:07.178615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:07.206062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:07.208273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:07.210782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:07.210782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:07.210782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:07.213538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 354/708] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:07.223184 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:07.223449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57d4cd-4d97-4a6a-82f9-ea59e99471a6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.282914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:07.284009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.284470 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.284931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.286007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:07.288506 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:07.289812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:07.299797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 355/709] 10.222.0.58 () {56 vars in 1124 bytes} [Sun Aug 28 00:47:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:07.308832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:07.423516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:07.467613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527d1a-e7e5-4931-8f54-93bafd3a86a1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.481558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487587-ff43-4983-928d-1ed400cc08ab None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.499724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:07.540931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7d3e-b8b1-4b4b-b729-eb0e5ab1fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:07.541551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7d3e-b8b1-4b4b-b729-eb0e5ab1fbcd None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.541835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7d3e-b8b1-4b4b-b729-eb0e5ab1fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.542107 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7d3e-b8b1-4b4b-b729-eb0e5ab1fbcd None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.542758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f7d3e-b8b1-4b4b-b729-eb0e5ab1fbcd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:07.543060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f7d3e-b8b1-4b4b-b729-eb0e5ab1fbcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:07.544504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f7d3e-b8b1-4b4b-b729-eb0e5ab1fbcd None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:07.552436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 356/710] 10.222.0.58 () {56 vars in 1124 bytes} [Sun Aug 28 00:47:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:07.559866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:07.560102 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20509-5ca9-4352-8469-3f5be82e4379 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.560189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20509-5ca9-4352-8469-3f5be82e4379 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.560441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20509-5ca9-4352-8469-3f5be82e4379 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.561306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.561798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.562269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.563195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 357/711] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:07.563396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:07.563916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:07.565564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:07.572285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e21a0-9432-46c2-bfc3-cc168c69287f None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.572285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e21a0-9432-46c2-bfc3-cc168c69287f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.572285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e21a0-9432-46c2-bfc3-cc168c69287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.597130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 355/712] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:07.601726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3e3e21a0-9432-46c2-bfc3-cc168c69287f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:07.603732 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:07.606921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3e3e21a0-9432-46c2-bfc3-cc168c69287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:07.755685 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c9a7-6fb0-4168-b42a-63f1605d5466 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.766462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 358/713] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:07.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:07.802051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.802525 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.803141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.810862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:07.812607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:07.825112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:07.826162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:07.827085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:07.829621 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 356/714] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:07.836289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e21a0-9432-46c2-bfc3-cc168c69287f None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:07.952796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e21a0-9432-46c2-bfc3-cc168c69287f None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.976489 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:08.001961 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:08.002757 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:08.003164 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:08.003561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:08.004400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:08.004809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:08.006877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:08.024149 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 359/715] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:08.030258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:08.041495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:08.115486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:08.155521 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9089e88-ac38-4fb2-9069-304ac1c44362 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:08.199881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:08.200499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:08.200780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:08.201056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:08.201801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=d1cdc7db1f714849ba14a987d2412591) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:08.202111 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:08.203598 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:08.226879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 357/716] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:08 2022] GET /identity/v3/role_assignments?user.id=d1cdc7db1f714849ba14a987d2412591&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:08.344724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c817d-f268-4830-9572-cdfa314fb205 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:08.387345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62a35-936f-4c42-a021-170542ef30d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:08.387991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62a35-936f-4c42-a021-170542ef30d9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:08.388272 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62a35-936f-4c42-a021-170542ef30d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:08.388542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62a35-936f-4c42-a021-170542ef30d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:08.389136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62a35-936f-4c42-a021-170542ef30d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:08.390529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb62a35-936f-4c42-a021-170542ef30d9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-7fb62a35-936f-4c42-a021-170542ef30d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:08.400678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:08.401943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:08.403145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 360/717] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:08 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:08.407934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:08.489940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:08.511057 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60310-76d2-4617-b2d8-d4fe8ec4f466 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:08.511434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60310-76d2-4617-b2d8-d4fe8ec4f466 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:08.511607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60310-76d2-4617-b2d8-d4fe8ec4f466 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:08.512964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 361/718] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:08.518667 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb215898-cfd2-4802-a379-bff58b63e982 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:08.518982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb215898-cfd2-4802-a379-bff58b63e982 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:08.519306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb215898-cfd2-4802-a379-bff58b63e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:08.526957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffcc9-c7c0-4b15-9ccd-1f199f16875f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:08.568165 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-bb215898-cfd2-4802-a379-bff58b63e982 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:08.569962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-bb215898-cfd2-4802-a379-bff58b63e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:08.572720 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:08.573342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:08.573620 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:08.573890 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:08.574532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] RBAC: Adding query filter params (name=network) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:08.574832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:08.576251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:08.586466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 358/719] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:08.593599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:08.645176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:08.723162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 362/720] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:08.781459 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2b0e-e1fc-45cf-a24d-140c988337df None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:08.841526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:08.842177 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:08.842417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:08.842667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:08.843310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:08.843614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:08.844985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:08.846490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:08.852074 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 359/721] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:09.026058 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb215898-cfd2-4802-a379-bff58b63e982 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:09.154253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb215898-cfd2-4802-a379-bff58b63e982 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:09.191275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:09.192268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.192766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.193818 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.204953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:09.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:09.212056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:09.212906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:09.215662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 363/722] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:09.222020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:09.374877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c2e7a-87ad-4d7a-ad73-01432ecce3b3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:09.430096 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b92e0d-c7dc-469d-83ae-75a4922da7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:09.430728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b92e0d-c7dc-469d-83ae-75a4922da7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.431007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b92e0d-c7dc-469d-83ae-75a4922da7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.431308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b92e0d-c7dc-469d-83ae-75a4922da7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.431995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b92e0d-c7dc-469d-83ae-75a4922da7a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:09.432301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b92e0d-c7dc-469d-83ae-75a4922da7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:09.433668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b92e0d-c7dc-469d-83ae-75a4922da7a4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:09.446490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 360/723] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:09.452101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:09.519658 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:09.573504 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9dbe-3cbc-4cdd-8af4-2ee0b5e2c62f None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.573822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9dbe-3cbc-4cdd-8af4-2ee0b5e2c62f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.574057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9dbe-3cbc-4cdd-8af4-2ee0b5e2c62f None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.575572 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 361/724] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:09.596161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2959f3-7e78-4e89-bcd9-dfb9be5d5e25 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.596446 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2959f3-7e78-4e89-bcd9-dfb9be5d5e25 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.596849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2959f3-7e78-4e89-bcd9-dfb9be5d5e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.628336 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-8d2959f3-7e78-4e89-bcd9-dfb9be5d5e25 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:09.629422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-8d2959f3-7e78-4e89-bcd9-dfb9be5d5e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:09.635470 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700137e-e7fc-448d-8e7b-844608e150a0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:09.678232 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:09.678903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.679202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.679476 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.701835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:09.703331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:09.733795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:09.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:09.735824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:09.735824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:09.735824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:09.737208 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 364/725] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:09.741358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:09.766303 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:09.791067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 362/726] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:47:09.869991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:09.893023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888f76a-442a-4862-a66d-5fc924f57f44 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:09.939028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:09.939667 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.939951 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.940219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.940962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:09.941263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:09.942625 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:09.959743 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 365/727] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:09.965365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2959f3-7e78-4e89-bcd9-dfb9be5d5e25 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.107011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.144107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2959f3-7e78-4e89-bcd9-dfb9be5d5e25 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.213131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff65d1e-a3b6-44e4-881d-949518a81606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.214436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65d1e-a3b6-44e4-881d-949518a81606 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.214727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65d1e-a3b6-44e4-881d-949518a81606 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.215296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65d1e-a3b6-44e4-881d-949518a81606 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.225422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff65d1e-a3b6-44e4-881d-949518a81606 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.227797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff65d1e-a3b6-44e4-881d-949518a81606 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-cff65d1e-a3b6-44e4-881d-949518a81606 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:10.248702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:10.249751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:10.250694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 363/728] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:10.252268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018aa5f-a604-4cee-a85e-2d70bb209421 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.253026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018aa5f-a604-4cee-a85e-2d70bb209421 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.253365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018aa5f-a604-4cee-a85e-2d70bb209421 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.255072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 364/729] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:10.260167 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018aa5f-a604-4cee-a85e-2d70bb209421 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.271903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5091a-8814-4d03-a5ac-fd7c11dc4b32 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.318708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e7c9d-6184-4dc5-b1ec-64b2b0485e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.319548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e7c9d-6184-4dc5-b1ec-64b2b0485e66 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.319823 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e7c9d-6184-4dc5-b1ec-64b2b0485e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.320092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e7c9d-6184-4dc5-b1ec-64b2b0485e66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.329845 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.333735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e7c9d-6184-4dc5-b1ec-64b2b0485e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:10.339681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-6b9e7c9d-6184-4dc5-b1ec-64b2b0485e66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:10.340750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:10.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:10.342814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 366/730] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:10.344276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0e2c-2f9b-4284-9274-eb17b5a181f2 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.344558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0e2c-2f9b-4284-9274-eb17b5a181f2 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.344828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0e2c-2f9b-4284-9274-eb17b5a181f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.366598 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-586e0e2c-2f9b-4284-9274-eb17b5a181f2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:10.368102 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-586e0e2c-2f9b-4284-9274-eb17b5a181f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:10.415687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018aa5f-a604-4cee-a85e-2d70bb209421 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.462285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 367/731] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:10.462285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0e2c-2f9b-4284-9274-eb17b5a181f2 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.464977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.471123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.471123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.471123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.471123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:10.471123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.471123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.498729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 365/732] 10.222.0.58 () {56 vars in 1135 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:10.503957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.663177 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e0e2c-2f9b-4284-9274-eb17b5a181f2 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.674412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b299-3c71-468c-8e2c-af506733123b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.684716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.694307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.700877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302886-ca79-4a81-bf8f-cef098c44a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.706871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302886-ca79-4a81-bf8f-cef098c44a3a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.706871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302886-ca79-4a81-bf8f-cef098c44a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.706871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302886-ca79-4a81-bf8f-cef098c44a3a None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.706871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302886-ca79-4a81-bf8f-cef098c44a3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:10.706871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302886-ca79-4a81-bf8f-cef098c44a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.706871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302886-ca79-4a81-bf8f-cef098c44a3a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.713537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8093a83-c368-4370-9eee-ef74835c3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.714431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8093a83-c368-4370-9eee-ef74835c3dce None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.714893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8093a83-c368-4370-9eee-ef74835c3dce None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.715363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8093a83-c368-4370-9eee-ef74835c3dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.720630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 368/733] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:10.722089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943cbc-8629-4490-942f-a7ef36d65dd7 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.722460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943cbc-8629-4490-942f-a7ef36d65dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.722806 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943cbc-8629-4490-942f-a7ef36d65dd7 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.729737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 369/734] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:10.730861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943cbc-8629-4490-942f-a7ef36d65dd7 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.800913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8093a83-c368-4370-9eee-ef74835c3dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.803328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8093a83-c368-4370-9eee-ef74835c3dce None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943cbc-8629-4490-942f-a7ef36d65dd7 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.892469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.893423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.893710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.894169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.905623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.907072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.923636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 366/735] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:47:10.923636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85069cf7-96d2-4882-a8f1-ae43533fb213 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.923636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85069cf7-96d2-4882-a8f1-ae43533fb213 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.923636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85069cf7-96d2-4882-a8f1-ae43533fb213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:10.924028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:10.926343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:10.932444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:10.932444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:10.932444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:10.932444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 370/736] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:10.932444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.945427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-85069cf7-96d2-4882-a8f1-ae43533fb213 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:10.946731 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-85069cf7-96d2-4882-a8f1-ae43533fb213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:10.949112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.978682 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:11.025759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 367/737] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:11.026626 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85069cf7-96d2-4882-a8f1-ae43533fb213 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.047948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8406-dd13-4ade-a4cb-56d31e56810e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.088119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.088901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.089273 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.089639 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.090493 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.092394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:11.152792 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85069cf7-96d2-4882-a8f1-ae43533fb213 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.190398 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6425-17c3-4c60-a280-c4e61c2fd412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.191352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6425-17c3-4c60-a280-c4e61c2fd412 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.191777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6425-17c3-4c60-a280-c4e61c2fd412 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.192272 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6425-17c3-4c60-a280-c4e61c2fd412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.200647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:11.208475 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 371/738] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:10 2022] POST /identity/v3/services => generated 251 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:11.210738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.214713 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6425-17c3-4c60-a280-c4e61c2fd412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.221318 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6425-17c3-4c60-a280-c4e61c2fd412 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-d40d6425-17c3-4c60-a280-c4e61c2fd412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:11.251507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:11.252863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:11.253881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:11.253881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:11.253881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:11.253881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 368/739] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:11.254169 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8fc96-4148-4103-a6bf-1a8edca90f2e None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.254599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8fc96-4148-4103-a6bf-1a8edca90f2e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.254891 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8fc96-4148-4103-a6bf-1a8edca90f2e None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.260596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 369/740] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:11.260596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8fc96-4148-4103-a6bf-1a8edca90f2e None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.364473 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:11.370454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697de3-85f1-4718-883b-3e7e92ed9044 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.399674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8fc96-4148-4103-a6bf-1a8edca90f2e None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.409988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e781bb3-e374-422a-8f3b-44574ac3632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.410848 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e781bb3-e374-422a-8f3b-44574ac3632e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.411280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e781bb3-e374-422a-8f3b-44574ac3632e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.411561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e781bb3-e374-422a-8f3b-44574ac3632e None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.413580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e781bb3-e374-422a-8f3b-44574ac3632e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:11.413580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e781bb3-e374-422a-8f3b-44574ac3632e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.415038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e781bb3-e374-422a-8f3b-44574ac3632e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:11.427348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 372/741] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:11.429310 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4eecb-1cb3-4f30-aa61-52a87e05577c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.429593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4eecb-1cb3-4f30-aa61-52a87e05577c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.429861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4eecb-1cb3-4f30-aa61-52a87e05577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.440663 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.441194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.441469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.441741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.442396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:11.442696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.444955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:11.448744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-71a4eecb-1cb3-4f30-aa61-52a87e05577c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:11.449968 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-71a4eecb-1cb3-4f30-aa61-52a87e05577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:11.459640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 370/742] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:11.459640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.511552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:11.526120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 373/743] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:47:11.527320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4eecb-1cb3-4f30-aa61-52a87e05577c None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.582877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166dd84-ce66-4a8e-9abd-a1e8045c52dc None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.622489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.623513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.624024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.624523 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.635804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:11.636592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:11.641702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:11.647758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 371/744] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:11.648846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.656665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4eecb-1cb3-4f30-aa61-52a87e05577c None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.697112 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.697976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.698401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.698837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.706949 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.708616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:11.722410 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:11.723662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:11.725065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:11.731535 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 374/745] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:11.732826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.764958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be7e99-769d-41ea-82c5-a873b2f14372 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.777645 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:11.807655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.809196 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.809816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.810367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.820424 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.822710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:11.835486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:11.836826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 372/746] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:11.838693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.856958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb38ec1-7494-41e6-90a8-27febd81835c None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.894170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.894801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.895083 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.895374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.896036 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:11.896941 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.898327 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:11.908581 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 375/747] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:11.909468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:11.929433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:11.956768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702a7b-c4f0-41d4-b19d-8da8eb964c8a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:11.994555 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:11.995119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:11.995401 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:11.995909 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:11.996659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:11.996966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:11.999116 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.023442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 373/748] 10.222.0.58 () {56 vars in 1149 bytes} [Sun Aug 28 00:47:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:12.024463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.031824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a07d66-f8f3-42d6-bd74-999c66906160 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.056286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:12.069335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.069996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.070279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.070553 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.071299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.072684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.125804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 376/749] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:11 2022] POST /identity/v3/services => generated 240 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:12.127162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.142531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7bad0-db0f-4f6f-88a8-a55d52e01d68 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.198178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.199136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.199633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.200089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.201015 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:12.201532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.203246 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.223894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 374/750] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:12.225210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:12.226644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.264338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a784c-121b-4061-8532-40abb3526d9e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.316098 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.317035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.317318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.317591 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.334442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.336411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.343170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:12.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:12.357089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:12.358018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:12.358018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:12.358018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:12.358018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 377/751] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:12.358018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.369383 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791164-2c5f-42ad-929a-e166463ab740 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.413131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.413941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.414220 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.414519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.478478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50de0b-78ce-4ee9-8109-79fa00ee04cf None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.490873 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.492552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.503399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:12.516029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.517062 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.517407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.517749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.518963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71cc361c23f94761bec36dec15efe691) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:12.519319 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.521041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.529815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 378/752] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/role_assignments?user.id=71cc361c23f94761bec36dec15efe691&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:12.531637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.593221 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:12.619574 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 375/753] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:12.626087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.681613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f071-a7ea-469b-9613-d387d97e99b0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.722012 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.723016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.723483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.723924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.725461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:12.726096 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.727667 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.743529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 379/754] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:12.749754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.823549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:12.861146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384e00d-15c7-48b8-a76f-86ac4832c65f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.890879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f370ff-3491-49c0-ae9f-e554ff07041c None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.934175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.934822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.935116 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.935395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.952253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.954458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:12.973166 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.973816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.974093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:12.974245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:12.975680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:12.976582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:12.976582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:12.976582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:12.976755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.976826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 376/755] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:12.981955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.988450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:12.990667 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.021988 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:13.022763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:13.024922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:13.027358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 380/756] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:13.034507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.223754 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da994b-8103-462e-8166-88782afb96b6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.252190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1450fc-cf57-4347-b418-f7b5467a5168 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.263444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.292543 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.293085 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.293356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.293477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.293639 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.293976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.294248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.294360 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:13.294514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.294666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.295185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:13.295485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.296880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.297143 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.318643 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 381/757] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:13.319382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 377/758] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:13.324285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.328683 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.489248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76812da-dad4-4686-b40f-dcabcb553907 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.497444 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.505636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4b663-6186-4de0-936d-ee80a55313b9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.531819 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119d5d3-ae65-4ae7-aa5d-1b13c77d0172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.532737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119d5d3-ae65-4ae7-aa5d-1b13c77d0172 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.533176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119d5d3-ae65-4ae7-aa5d-1b13c77d0172 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.533668 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119d5d3-ae65-4ae7-aa5d-1b13c77d0172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.546152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119d5d3-ae65-4ae7-aa5d-1b13c77d0172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.547621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119d5d3-ae65-4ae7-aa5d-1b13c77d0172 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.552031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfe1c6-40f4-4eb0-8187-f7f5eb78851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.553756 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe1c6-40f4-4eb0-8187-f7f5eb78851e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.554456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe1c6-40f4-4eb0-8187-f7f5eb78851e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.555175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe1c6-40f4-4eb0-8187-f7f5eb78851e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.564362 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfe1c6-40f4-4eb0-8187-f7f5eb78851e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-c119d5d3-ae65-4ae7-aa5d-1b13c77d0172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:13.564564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:13.565656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:13.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:13.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:13.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:13.566879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 382/759] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:13.567146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dc01-5569-4055-8a5c-730a31ab653b None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.567418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dc01-5569-4055-8a5c-730a31ab653b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.567693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dc01-5569-4055-8a5c-730a31ab653b None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.569709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfe1c6-40f4-4eb0-8187-f7f5eb78851e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.573226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 383/760] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:13.574081 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6dc01-5569-4055-8a5c-730a31ab653b None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-d5cfe1c6-40f4-4eb0-8187-f7f5eb78851e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:13.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:13.586330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:13.587299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:13.588768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 378/761] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:13.589981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4df34-0665-4867-8b3f-4866fb348209 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.590261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4df34-0665-4867-8b3f-4866fb348209 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.590533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4df34-0665-4867-8b3f-4866fb348209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.601715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.609179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-20a4df34-0665-4867-8b3f-4866fb348209 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:13.610385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-20a4df34-0665-4867-8b3f-4866fb348209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:13.691392 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 379/762] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:13.692364 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4df34-0665-4867-8b3f-4866fb348209 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.698225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6dc01-5569-4055-8a5c-730a31ab653b None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.761846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.762855 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.763367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.763878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.764722 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:13.765031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.766425 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.795126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 384/763] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:13.809298 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.809649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.826504 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4df34-0665-4867-8b3f-4866fb348209 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.865143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.866176 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.866672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.867171 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.868079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:13.868607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.870298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.883760 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 380/764] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:13.889166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.986580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:14.018164 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212edd66-2e3b-414f-ace1-0e41fa44a6c4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:14.065152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:14.065702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.065976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.066246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.074976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:14.076454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:14.087634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729bad2-06d8-43ac-8992-91dacc0be09b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:14.088572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:14.094248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 385/765] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:14.095173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:14.141650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:14.142270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.142549 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.142816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.144042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=22cbba46308046d7b15f6f3a14e9eab6) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:14.144351 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:14.146532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:14.154606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 381/766] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/role_assignments?user.id=22cbba46308046d7b15f6f3a14e9eab6&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:14.156185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:14.172357 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:14.285008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee678f-b345-4a8c-8da7-0bc9418dd9e6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:14.326842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:14.327432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.327710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.327984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.328709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:14.329020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:14.330488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:14.337606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9862b3-678f-4878-bd0a-92ef761c3bac None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:14.346915 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 382/767] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:14.354115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:14.409204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:14.409892 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.410175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.410445 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.411026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:14.413195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:14.423801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:14.424875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:14.425731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 386/768] 10.222.0.58 () {56 vars in 1129 bytes} [Sun Aug 28 00:47:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:14.436169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:14.441592 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:14.442161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:14.480089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95e835-dbdd-461e-8998-1aa9df5a7e86 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:14.529950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff614fc-4628-45de-ad48-b63d4367335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:14.530644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff614fc-4628-45de-ad48-b63d4367335d None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.530920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff614fc-4628-45de-ad48-b63d4367335d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.531253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff614fc-4628-45de-ad48-b63d4367335d None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/d1cdc7db1f714849ba14a987d2412591/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.534242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff614fc-4628-45de-ad48-b63d4367335d None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=d1cdc7db1f714849ba14a987d2412591, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:14.536497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff614fc-4628-45de-ad48-b63d4367335d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:14.559546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9667-fb35-4489-b1de-3cba2200e4fa None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:14.597385 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6636aa-b906-4498-afbd-7791a816c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:14.597972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6636aa-b906-4498-afbd-7791a816c506 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.598275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6636aa-b906-4498-afbd-7791a816c506 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.598546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6636aa-b906-4498-afbd-7791a816c506 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.599277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6636aa-b906-4498-afbd-7791a816c506 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:14.599581 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6636aa-b906-4498-afbd-7791a816c506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:14.600953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6636aa-b906-4498-afbd-7791a816c506 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:14.607224 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 387/769] 10.222.0.58 () {56 vars in 1124 bytes} [Sun Aug 28 00:47:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:14.609239 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40632-0356-44be-9fb3-eba53c921ded None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.609563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40632-0356-44be-9fb3-eba53c921ded None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.609841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40632-0356-44be-9fb3-eba53c921ded None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.611523 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 388/770] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:14.612776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 383/771] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:47:14 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/d1cdc7db1f714849ba14a987d2412591/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:47:14.619545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c40632-0356-44be-9fb3-eba53c921ded None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:14.622118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd75fc-e7ba-4988-82ed-a1dfe1d98fd0 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.622923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd75fc-e7ba-4988-82ed-a1dfe1d98fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.623706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd75fc-e7ba-4988-82ed-a1dfe1d98fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.680880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a1fd75fc-e7ba-4988-82ed-a1dfe1d98fd0 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:14.683930 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a1fd75fc-e7ba-4988-82ed-a1dfe1d98fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:14.763212 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:14.826507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c40632-0356-44be-9fb3-eba53c921ded None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:14.837020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 384/772] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:14.866109 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:14.867135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.867623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.868097 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.868934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:14.869438 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:14.871035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:14.877018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 389/773] 10.222.0.58 () {56 vars in 1124 bytes} [Sun Aug 28 00:47:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:14.879042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502849-e024-44ca-bb13-bc1903180a04 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.879571 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502849-e024-44ca-bb13-bc1903180a04 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.880047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502849-e024-44ca-bb13-bc1903180a04 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.882391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 385/774] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:14.883563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:14.887290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efefa-cf35-4a45-b449-f9a1e0237fec None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:14.887794 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efefa-cf35-4a45-b449-f9a1e0237fec None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:14.888263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efefa-cf35-4a45-b449-f9a1e0237fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:14.919661 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-5b9efefa-cf35-4a45-b449-f9a1e0237fec None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:14.922063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-5b9efefa-cf35-4a45-b449-f9a1e0237fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:15.014277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:15.037536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 386/775] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:15.112424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b2e61-9372-47eb-9b9a-34bebaa723dc None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.167645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:15.171921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:15.172877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.173677 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.174151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.175320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] RBAC: Adding query filter params (interface=public, service_id=23c2ab75008947169e7fdf0e6bcb8c7c, region_id=RegionOne) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:15.175836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:15.178524 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:15.191862 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 390/776] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:47:14 2022] GET /identity/v3/endpoints?service_id=23c2ab75008947169e7fdf0e6bcb8c7c&interface=public®ion_id=RegionOne => generated 194 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:15.200528 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9efefa-cf35-4a45-b449-f9a1e0237fec None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.255885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.377085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9efefa-cf35-4a45-b449-f9a1e0237fec None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.388052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d041cf-d80c-4957-a571-df0fb9bb36cd None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.416722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:15.417342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.417622 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.417951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.418576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:15.420010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:15.425841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 387/777] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:15.426768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.432586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:15.433578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.434033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.434450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] PATH_INFO: `/v3/services/network` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.435225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:15.437580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:15.451188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:15.452302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:15.453141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:15.456397 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 391/778] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:15.466497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.565324 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:15.641688 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:15.690210 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03e63-4f93-41e1-aaf0-7e318ba73883 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.703866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767110ea-9976-43be-9092-58a3ff5c2758 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.736965 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:15.737640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.737908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.738173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.748751 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:15.749369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.749647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.749918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.750549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] RBAC: Adding query filter params (name=network) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:15.750850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:15.752260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:15.763034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 392/779] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:15.763837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:15.768652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:15.769592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:15.770457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 388/780] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:15.780224 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.791117 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.947068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3dee3-2fd3-4dde-b4e3-6800795b9893 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.982257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:15.993156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5324-d235-42c9-8cc6-e8b519b5a9af None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:15.996977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:15.997607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.998003 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.998279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.998924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] RBAC: Adding query filter params (type=network) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:15.999257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.000650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.012278 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.015796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 393/781] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:16.028232 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.038222 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.039741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.040343 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.040882 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.042113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:16.042704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.045305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.059627 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 389/782] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:16.066106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.247542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7b9b-b2aa-4f11-9081-748e6f4697be None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.288155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2ec8-3ccf-463a-88d7-83e0b4931f5a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.310397 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.310998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.311303 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.311577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.312287 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] RBAC: Adding query filter params (interface=public, service_id=c8ad112e25484646b072bf4e06408365, region_id=RegionOne) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:16.312596 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.313982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.329113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 394/783] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/endpoints?service_id=c8ad112e25484646b072bf4e06408365&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:16.336695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.379883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.381113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.381536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.382030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.398235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.408251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.409726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:16.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:16.446589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:16.447538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:16.447538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:16.447538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:16.447538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 390/784] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:16.457118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.462460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad4e0-9955-497e-9933-fee310ea8bda None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.512852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24df0d-6295-4eb1-96b9-96cab1f81f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.513821 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24df0d-6295-4eb1-96b9-96cab1f81f94 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.514421 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24df0d-6295-4eb1-96b9-96cab1f81f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.514889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24df0d-6295-4eb1-96b9-96cab1f81f94 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.517574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24df0d-6295-4eb1-96b9-96cab1f81f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.519233 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24df0d-6295-4eb1-96b9-96cab1f81f94 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.530982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 395/785] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:16.532678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.570035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5899-8416-4316-8d51-f178c2ad0020 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.570392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5899-8416-4316-8d51-f178c2ad0020 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.570571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5899-8416-4316-8d51-f178c2ad0020 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.572231 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 396/786] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:16.580039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b45ce1-eb43-4f1a-b6aa-3bafa36c8284 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.580383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b45ce1-eb43-4f1a-b6aa-3bafa36c8284 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.580593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b45ce1-eb43-4f1a-b6aa-3bafa36c8284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.603575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-a2b45ce1-eb43-4f1a-b6aa-3bafa36c8284 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:16.605152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-a2b45ce1-eb43-4f1a-b6aa-3bafa36c8284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:16.639469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c508c-4ff0-4c4b-a2dc-900b36fbe29c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.689657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.690653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.691181 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.697153 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 397/787] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:16.697939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.698889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:16.699422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.701062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.727608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 391/788] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:16.732703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b45ce1-eb43-4f1a-b6aa-3bafa36c8284 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.802009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.861518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b45ce1-eb43-4f1a-b6aa-3bafa36c8284 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.909054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df03a5-d7ac-4762-a74a-183d40212525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.909701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df03a5-d7ac-4762-a74a-183d40212525 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.909978 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df03a5-d7ac-4762-a74a-183d40212525 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.910249 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df03a5-d7ac-4762-a74a-183d40212525 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.919697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df03a5-d7ac-4762-a74a-183d40212525 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.921221 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df03a5-d7ac-4762-a74a-183d40212525 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-34df03a5-d7ac-4762-a74a-183d40212525 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:16.936856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:16.937870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:16.939482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 398/789] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:16.944946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.084546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd6d4-7cc2-49cc-af41-35c990c06bad None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.084792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd6d4-7cc2-49cc-af41-35c990c06bad None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.085412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd6d4-7cc2-49cc-af41-35c990c06bad None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.088338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 399/790] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:17.089222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd6d4-7cc2-49cc-af41-35c990c06bad None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.089666 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:17.102988 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537dffb-5ed0-4e40-a8db-49faa998e9a2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.147748 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4566b3-76d3-461f-bfb6-1575cf835d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:17.148760 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4566b3-76d3-461f-bfb6-1575cf835d6f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.149132 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4566b3-76d3-461f-bfb6-1575cf835d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.149477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4566b3-76d3-461f-bfb6-1575cf835d6f None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.150298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4566b3-76d3-461f-bfb6-1575cf835d6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:17.150672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4566b3-76d3-461f-bfb6-1575cf835d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:17.153059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4566b3-76d3-461f-bfb6-1575cf835d6f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:17.179118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 392/791] 10.222.0.58 () {56 vars in 1135 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:17.180939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d7e48-db78-47b6-ac8e-5e39279ad874 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.181321 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d7e48-db78-47b6-ac8e-5e39279ad874 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.182114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d7e48-db78-47b6-ac8e-5e39279ad874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.201851 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd6d4-7cc2-49cc-af41-35c990c06bad None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.205467 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:17.207608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-453d7e48-db78-47b6-ac8e-5e39279ad874 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:17.208933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-453d7e48-db78-47b6-ac8e-5e39279ad874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:17.248517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:17.249148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.249419 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.249688 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.261911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:17.268623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:17.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:17.270559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 400/792] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:17.272237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.306898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 393/793] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:17.307905 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d7e48-db78-47b6-ac8e-5e39279ad874 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.415633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:17.428263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d7e48-db78-47b6-ac8e-5e39279ad874 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.500332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56159-e31c-4c51-b789-feb1f734abd4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.505629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:17.506248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.506522 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.506787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.507480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:17.507776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:17.509137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:17.534013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 394/794] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:17.539896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.579295 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:17.579991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.580263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.580529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.595941 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:17.598309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:17.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:17.633243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:17.634171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:17.634171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:17.634171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:17.636307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 401/795] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:17.641747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.671026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:17.697230 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ec7e2-c0ec-425b-bb16-7097efe95498 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.746676 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:17.747484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.747668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.747903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.758755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:17.764538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:17.766486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:17.772698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9a39-bdf9-4420-8ed1-f251d45be9d7 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:17.785149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:17.786178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:17.787156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:17.787156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:17.787156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:17.791256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 395/796] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:17.792324 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.813449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:17.814436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.814946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.815494 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.829361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:17.835189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:17.836194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:17.837046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:17.839815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 402/797] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:17.841164 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:17.915675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45baa9-abff-44fc-a00d-e06d1e14be28 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.941120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:17.953395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:17.957494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:17.957494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:17.957494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:17.957494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:17.957494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:17.957494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:17.967603 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507341be-cd03-4075-bc5d-1139fe85ac41 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:17.976514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 396/798] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:17.977632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.015834 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33523af1-73f2-4e15-9df7-5701edfa3893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.016454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523af1-73f2-4e15-9df7-5701edfa3893 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.016745 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523af1-73f2-4e15-9df7-5701edfa3893 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.016994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523af1-73f2-4e15-9df7-5701edfa3893 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.017820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33523af1-73f2-4e15-9df7-5701edfa3893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:18.018132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33523af1-73f2-4e15-9df7-5701edfa3893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.020537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33523af1-73f2-4e15-9df7-5701edfa3893 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.044529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 403/799] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:18.044529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218c64-e598-47e6-a12d-368c1b27b560 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.044529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218c64-e598-47e6-a12d-368c1b27b560 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.044529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218c64-e598-47e6-a12d-368c1b27b560 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.044529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 404/800] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:18.044529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e218c64-e598-47e6-a12d-368c1b27b560 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:18.116491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec25e-4b9d-4c1e-87f8-04fc16303088 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.157038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.157661 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.157968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.158216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.159135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:18.159374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.160625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.170326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 397/801] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:18.171509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.171771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e218c64-e598-47e6-a12d-368c1b27b560 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.217282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fe7ad-f825-41e0-9881-24c0bc05dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.217876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fe7ad-f825-41e0-9881-24c0bc05dbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.218154 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fe7ad-f825-41e0-9881-24c0bc05dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.218458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fe7ad-f825-41e0-9881-24c0bc05dbe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.221378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:18.226557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fe7ad-f825-41e0-9881-24c0bc05dbe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.228130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fe7ad-f825-41e0-9881-24c0bc05dbe2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-803fe7ad-f825-41e0-9881-24c0bc05dbe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:18.240744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:18.241739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:18.242649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 405/802] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:18.243526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2caa-50d0-4eb7-9144-b8d2b56f4c36 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.243526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2caa-50d0-4eb7-9144-b8d2b56f4c36 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.243666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2caa-50d0-4eb7-9144-b8d2b56f4c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.264148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-be9a2caa-50d0-4eb7-9144-b8d2b56f4c36 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:18.265338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-be9a2caa-50d0-4eb7-9144-b8d2b56f4c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:18.319865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186f442-3559-4117-b5ad-c29b4c7854c1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.338646 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:18.355130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 406/803] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:18.355130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2caa-50d0-4eb7-9144-b8d2b56f4c36 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.372703 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.373444 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.373721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.374003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.382950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.384569 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:18.397580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:18.398606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 398/804] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:18.399640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.477104 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2caa-50d0-4eb7-9144-b8d2b56f4c36 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.505981 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:18.517358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.518801 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.519290 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.525574 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde71b-6d95-4eae-ae56-d17a25bb4049 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.533566 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.535495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:18.552816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:18.554046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:18.555214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:18.555214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:18.555214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:18.556983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 407/805] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:18.558064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.571617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.572604 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.572880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.573254 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.574056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:18.574460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.576131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.591521 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 399/806] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:18.592632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.628039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:18.688596 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b638-8d67-4a31-aef7-c32b7e5f7234 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.710961 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b826f4-3260-40b2-a63a-dd3a932fe859 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.728322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.728851 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.729129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.729397 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.730135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:18.730443 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.731921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.753529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 408/807] 10.222.0.58 () {56 vars in 1149 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:18.754115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.759803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.760497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.760781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.761052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.761708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:18.762008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.763403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.776682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 400/808] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:18.777401 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.804151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:18.878244 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669229-9f44-40d5-9bda-94854be7a619 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.881716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:18.890258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c1330-69a8-4aac-be1c-c08802b8c6bd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:18.916776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.917442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.917724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.918002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/71cc361c23f94761bec36dec15efe691/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.919983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=71cc361c23f94761bec36dec15efe691, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.921419 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.925178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:18.925810 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:18.926084 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:18.926353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:18.926936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:18.928588 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:18.939653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:18.944868 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:18.945730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 401/809] 10.222.0.58 () {56 vars in 1129 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:18.946650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:18.987681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 409/810] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:47:18 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/71cc361c23f94761bec36dec15efe691/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:47:18.988442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.067259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a2b50-abf8-43f4-b516-35471b2f6445 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.109224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70320388-4a41-4724-921b-35243d26ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.109902 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320388-4a41-4724-921b-35243d26ef65 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.110177 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320388-4a41-4724-921b-35243d26ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.110566 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320388-4a41-4724-921b-35243d26ef65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.111683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:19.123645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5b5bb-306b-4683-9169-e33970fce216 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.125759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70320388-4a41-4724-921b-35243d26ef65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.128438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70320388-4a41-4724-921b-35243d26ef65 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-70320388-4a41-4724-921b-35243d26ef65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:19.150562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:19.151587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:19.152493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:19.152493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:19.152493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:19.152493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 402/811] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:19.153227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72e68-05f6-42ee-bc7e-9898dcd3de7c None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.153506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72e68-05f6-42ee-bc7e-9898dcd3de7c None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.153776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d72e68-05f6-42ee-bc7e-9898dcd3de7c None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.159285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 403/812] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:19.160187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72e68-05f6-42ee-bc7e-9898dcd3de7c None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.173605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19ceb8-ff43-4133-a357-ce235618543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.174261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19ceb8-ff43-4133-a357-ce235618543c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.174571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19ceb8-ff43-4133-a357-ce235618543c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.174843 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19ceb8-ff43-4133-a357-ce235618543c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.175507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:19.187264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19ceb8-ff43-4133-a357-ce235618543c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.189258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19ceb8-ff43-4133-a357-ce235618543c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-cd19ceb8-ff43-4133-a357-ce235618543c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:19.205644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:19.206672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 410/813] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:47:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:19.208289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b76afe-b378-4fd7-9f27-e8ec8d9c4737 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.209706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b76afe-b378-4fd7-9f27-e8ec8d9c4737 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.209706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b76afe-b378-4fd7-9f27-e8ec8d9c4737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.228534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-b2b76afe-b378-4fd7-9f27-e8ec8d9c4737 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:19.229732 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-b2b76afe-b378-4fd7-9f27-e8ec8d9c4737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:19.297488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d72e68-05f6-42ee-bc7e-9898dcd3de7c None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.315545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 411/814] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:19.315545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b76afe-b378-4fd7-9f27-e8ec8d9c4737 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.347883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.348510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.348783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.349719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.350479 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:19.350780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.352212 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.362672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 404/815] 10.222.0.58 () {56 vars in 1124 bytes} [Sun Aug 28 00:47:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:19.362672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.449481 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:19.450094 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:19.472001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b76afe-b378-4fd7-9f27-e8ec8d9c4737 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.492695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c90c-4bfd-4821-aee1-2438eaceb46b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.519572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.520996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.521793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.522407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.523467 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:19.524207 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.527063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.534490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.535260 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.536151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.536151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.537519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:19.537921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.539587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.548132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 412/816] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:19.548132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 405/817] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:19.579579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.683989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff940c7-350a-4c70-a938-e5cc2dfcbeb3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.717416 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984da57-bdb6-4310-8ee4-45f645a8e4f8 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.727001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.729119 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.729588 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.729863 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.731286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:19.731286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.732607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 413/818] 10.222.0.58 () {56 vars in 1124 bytes} [Sun Aug 28 00:47:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:19.743808 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.756393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:19.759265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:19.770542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.779075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.779075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.779075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.779532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.780984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:19.795953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:19.796898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:19.797801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 406/819] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:19.798434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:19.874411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4eff-cffd-4fec-ab92-9880405ec161 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.915731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.916335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.916613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.916889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.939130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748cb1b-2123-44b8-89a8-2d34180cfc4f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:19.983279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:19.983279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:19.983279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:19.983279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:19.983749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.985169 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:19.997231 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:19.997537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:19.999340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:20.000991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 407/820] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:19 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:20.002363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.002448 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:20.015048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:20.075316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:20.126233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62d52-edca-4fc6-b3ac-57ba034793e9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:20.126781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 414/821] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:20.127771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.169498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:20.170113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.170390 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.170664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.171368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:20.172739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:20.234893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907e290-0daa-4f48-9a80-f6297bbdcf61 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:20.285261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 408/822] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:20.285261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.368204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:20.419462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:20.420220 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.420559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.420896 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.421667 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:20.422101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:20.423290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec075e-884b-45e0-8282-f88ce073a963 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:20.423721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:20.433410 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:20.443565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 415/823] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:20.455520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.470806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773c392-1839-427d-becd-17c1732688bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:20.471556 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c392-1839-427d-becd-17c1732688bc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.472007 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c392-1839-427d-becd-17c1732688bc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.472635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c392-1839-427d-becd-17c1732688bc None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.473600 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773c392-1839-427d-becd-17c1732688bc None admin] RBAC: Adding query filter params (name=network) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:20.475015 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773c392-1839-427d-becd-17c1732688bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:20.476573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773c392-1839-427d-becd-17c1732688bc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:20.481348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 409/824] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:20.482318 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773c392-1839-427d-becd-17c1732688bc None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.586326 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648021-d90b-4b7c-a57f-ed785d25ad85 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:20.624333 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773c392-1839-427d-becd-17c1732688bc None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:20.625611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:20.626256 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.626534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.626807 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.638423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:20.640123 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:20.659192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:20.660181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:20.661101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:20.661101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:20.661101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:20.667253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 416/825] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:20.667253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.683363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:20.685209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.685724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.686198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/22cbba46308046d7b15f6f3a14e9eab6/roles/826c400ad3c34b06933206c5b981d0b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.691979 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:20.712012 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=22cbba46308046d7b15f6f3a14e9eab6, role_id=826c400ad3c34b06933206c5b981d0b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:20.713852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:20.786757 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815161b-7ee9-462c-98f8-dce6193548e0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:20.791130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 410/826] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:47:20 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/22cbba46308046d7b15f6f3a14e9eab6/roles/826c400ad3c34b06933206c5b981d0b0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:47:20.792250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.827771 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:20.830352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:20.831033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:20.831350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:20.831664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:20.832251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] RBAC: Adding query filter params (type=network) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:20.832557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:20.834549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:20.845362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 417/827] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:20.847451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:20.963661 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449c40-c36a-46be-83f8-9d885885f340 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:20.966085 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:20.996835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aaef3-bd54-4c25-97b7-431a07cf5abf None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:21.005854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efab04d-d774-4e73-8369-6507386e7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.006477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab04d-d774-4e73-8369-6507386e7166 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.006744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab04d-d774-4e73-8369-6507386e7166 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.007008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab04d-d774-4e73-8369-6507386e7166 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.008470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efab04d-d774-4e73-8369-6507386e7166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:21.008769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efab04d-d774-4e73-8369-6507386e7166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:21.010228 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efab04d-d774-4e73-8369-6507386e7166 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:21.022995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 411/828] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:21.024766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd865cbe-6062-48a9-a3f3-f12d244217e9 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.024766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd865cbe-6062-48a9-a3f3-f12d244217e9 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.024766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd865cbe-6062-48a9-a3f3-f12d244217e9 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.026126 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 412/829] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:21.031932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e4f20-3c2d-408d-b588-3a3962e80648 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.032234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e4f20-3c2d-408d-b588-3a3962e80648 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.032476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e4f20-3c2d-408d-b588-3a3962e80648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.044578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.045546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.046044 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.046861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:21.049272 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:21.053120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b41e4f20-3c2d-408d-b588-3a3962e80648 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:21.054495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b41e4f20-3c2d-408d-b588-3a3962e80648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:21.131684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 413/830] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:21.132564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e4f20-3c2d-408d-b588-3a3962e80648 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:21.135181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 418/831] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:20 2022] POST /identity/v3/endpoints => generated 337 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:47:21.159936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:21.314398 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e4f20-3c2d-408d-b588-3a3962e80648 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:21.370733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.371409 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.371678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.371940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.379261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:21.381236 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:21.393079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:21.394019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:21.394916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 414/832] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:21.401190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:21.408292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:21.502932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:21.537344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fdea8-765f-4510-acf3-557054da67f6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:21.544849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de4f73-0ea2-4322-9153-cdbe15eada27 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:21.580730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.581277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.581559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.581833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.584423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:21.584739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:21.587175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:21.592251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.594983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.595796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:21.596356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.596842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.606654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 419/833] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:21.609515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:21.615073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:21.621722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:21.622768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:21.624305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 415/834] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:21.635714 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:21.756391 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968401-a89d-4863-89fd-1f6e8c953e45 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:21.761754 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22cfd-be1d-4d85-89f2-c13c433cc0cd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:21.791633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:21.806593 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.807235 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.807517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.807794 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.808475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:21.808593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.808785 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:21.809627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.810142 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.810312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:21.810766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:21.811934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=d1cdc7db1f714849ba14a987d2412591) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:21.812443 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:21.814355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:21.823144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 416/835] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:21.827185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:21.827957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 420/836] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:21 2022] GET /identity/v3/role_assignments?user.id=d1cdc7db1f714849ba14a987d2412591&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:21.954491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc77a8-3aed-4873-ae29-538beb8376d8 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:21.996526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:21.997506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:21.997987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:21.998489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:22.012019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:22.013498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:22.032098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:22.033128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:22.034470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:22.034470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:22.034470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:22.034470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 417/837] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:22.039594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:22.110122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:22.153443 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d9a4-b82e-4585-9875-3912d732c416 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:22.192224 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:22.192939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:22.193230 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:22.193499 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:22.194146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:22.194501 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:22.195899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:22.210054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 421/838] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:22.215848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:22.264003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:22.327844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f4cd7-6cbe-4ac6-867d-9b36fdf54778 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:22.365074 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e808cd-6402-4762-bb87-6ddbcf1cc2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:22.366055 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e808cd-6402-4762-bb87-6ddbcf1cc2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:22.366539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e808cd-6402-4762-bb87-6ddbcf1cc2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:22.367015 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e808cd-6402-4762-bb87-6ddbcf1cc2d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:22.375385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e808cd-6402-4762-bb87-6ddbcf1cc2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:22.377108 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e808cd-6402-4762-bb87-6ddbcf1cc2d1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-47e808cd-6402-4762-bb87-6ddbcf1cc2d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:22.389665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:22.390652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:47:22.391691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:22.394323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 418/839] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:22.399919 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:22.469046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ed63-d59d-4ee6-961a-77aad20596d8 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:22.469222 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ed63-d59d-4ee6-961a-77aad20596d8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:22.469500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ed63-d59d-4ee6-961a-77aad20596d8 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:22.471081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 419/840] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:22.476953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a70fb-0c37-4405-b828-8442767667c2 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:22.477228 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a70fb-0c37-4405-b828-8442767667c2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:22.477502 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a70fb-0c37-4405-b828-8442767667c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:22.496799 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-139a70fb-0c37-4405-b828-8442767667c2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:22.498585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-139a70fb-0c37-4405-b828-8442767667c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:22.517258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79923-79bb-4d60-a5e1-7d34a101b088 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:22.547412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:22.566498 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:22.567400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:22.568418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:22.568742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:22.569960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:22.570271 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:22.572291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:22.581957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 420/841] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:22.594848 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 422/842] 10.222.0.58 () {56 vars in 1135 bytes} [Sun Aug 28 00:47:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:22.604946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a70fb-0c37-4405-b828-8442767667c2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:22.634324 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:22.717092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a70fb-0c37-4405-b828-8442767667c2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:22.754729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:22.755901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:22.756432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:22.756911 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:22.833779 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:22.835248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:22.866511 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:22.898730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:22.941269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 421/843] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:22.947346 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.021889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea24df2-943f-4113-bc99-3ce85069efe0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.064647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e57da-e6be-46d0-84d7-10761a37f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.065409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e57da-e6be-46d0-84d7-10761a37f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.065689 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e57da-e6be-46d0-84d7-10761a37f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.065969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e57da-e6be-46d0-84d7-10761a37f7e8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.066594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e57da-e6be-46d0-84d7-10761a37f7e8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.068090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e57da-e6be-46d0-84d7-10761a37f7e8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.073033 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b0755-14f5-4a09-b4d9-f95a4cc95c8e None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-bb8e57da-e6be-46d0-84d7-10761a37f7e8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:23.077344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:23.078320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:23.080656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:23.084045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 423/844] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:23.085727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d79b3-4741-45d7-a91a-e9ec8a2576a7 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.086009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d79b3-4741-45d7-a91a-e9ec8a2576a7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.086288 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d79b3-4741-45d7-a91a-e9ec8a2576a7 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.087635 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 424/845] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:23.088334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d79b3-4741-45d7-a91a-e9ec8a2576a7 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.109251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:23.116406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a2ead-dfc1-40a5-94d9-f119a82ab89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.117043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2ead-dfc1-40a5-94d9-f119a82ab89e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.117326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2ead-dfc1-40a5-94d9-f119a82ab89e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.122388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2ead-dfc1-40a5-94d9-f119a82ab89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.128552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a2ead-dfc1-40a5-94d9-f119a82ab89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.130594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a2ead-dfc1-40a5-94d9-f119a82ab89e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.142374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-eb9a2ead-dfc1-40a5-94d9-f119a82ab89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:23.149227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:23.150438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:23.151557 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:23.151557 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:23.151557 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:23.158518 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 422/846] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:23.160146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c304-c933-48fb-9f80-1fa74d6608ad None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.160429 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c304-c933-48fb-9f80-1fa74d6608ad None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.160709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c304-c933-48fb-9f80-1fa74d6608ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.179020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b1f4c304-c933-48fb-9f80-1fa74d6608ad None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:23.180249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b1f4c304-c933-48fb-9f80-1fa74d6608ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:23.202257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d79b3-4741-45d7-a91a-e9ec8a2576a7 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.241047 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.241643 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.241915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.242235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.242793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:23.243131 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.244466 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.253557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 425/847] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:23.253557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.256087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 423/848] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:23.256996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c304-c933-48fb-9f80-1fa74d6608ad None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.367702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c304-c933-48fb-9f80-1fa74d6608ad None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.381926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21a66-7d31-49bf-839f-0298de770fdb None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.387358 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:23.391800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:23.416613 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.417682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.418421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.418995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.419903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:23.420219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.422177 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.427362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.427517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 424/849] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:23.428356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.428636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.428905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.429557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:23.429854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.431322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.446309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 426/850] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:23.452759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.572250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd5e16-3e2d-48a2-91d3-efc0b5411922 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.584035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.613001 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.613645 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.613922 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.614196 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.621657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.623127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:23.634842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:23.639159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:23.640173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 425/851] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:23.642747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:23.712515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ddf7-951c-48bc-aaeb-f8593008b119 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.751938 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.753029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.753515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.753973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.766878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:23.768341 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0d08e-2c4a-4ed0-8b3a-cbfcff696e05 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:23.772684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:23.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:47:23.774663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:23.783646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 427/852] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:23.784810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.804998 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.805609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.805886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.806157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.806852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:23.807235 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.808665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.819962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:23.824720 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 426/853] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:23.830638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.898008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419ff7-730a-40d2-a0db-2675d9ac9630 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.938512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:23.943148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.944087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.944457 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.951594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.951594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:23.951594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.951894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d097c52-c84f-42f6-b538-5337abd75af5 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:23.951985 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.958733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 428/854] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:23.966430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:23.984777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985075b-f965-4588-b689-e759de806bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:23.985381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985075b-f965-4588-b689-e759de806bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.985652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985075b-f965-4588-b689-e759de806bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.985918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985075b-f965-4588-b689-e759de806bb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.986640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985075b-f965-4588-b689-e759de806bb3 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71cc361c23f94761bec36dec15efe691) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:23.986939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985075b-f965-4588-b689-e759de806bb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:23.988683 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985075b-f965-4588-b689-e759de806bb3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:23.996322 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 427/855] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/role_assignments?user.id=71cc361c23f94761bec36dec15efe691&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:23.997531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112f03-7bbb-400c-81e4-ced4ef04ca92 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:23.997806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112f03-7bbb-400c-81e4-ced4ef04ca92 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:23.998070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112f03-7bbb-400c-81e4-ced4ef04ca92 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:23.999686 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 428/856] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:24.009571 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddf06-714f-4150-8120-53a86a21041d None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.010037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddf06-714f-4150-8120-53a86a21041d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.010190 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddf06-714f-4150-8120-53a86a21041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.030206 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-da2ddf06-714f-4150-8120-53a86a21041d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:24.031484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-da2ddf06-714f-4150-8120-53a86a21041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:24.086521 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.099244 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d9ec1-d9a4-4ee5-ace1-5fdba8f2ea9e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.115545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 429/857] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:24.141392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.142441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.142948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.143459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.156775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:24.158765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:24.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:24.177607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:24.178505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:24.178505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:24.178505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:24.183052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 429/858] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:24.186812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ddf06-714f-4150-8120-53a86a21041d None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:24.291468 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.302156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ddf06-714f-4150-8120-53a86a21041d None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.338455 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.339429 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.339890 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.340612 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.341475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:24.341959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:24.343544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:24.361104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 430/859] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:24.362725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:24.399941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:24.472849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358127e-fb8c-4df2-b37c-f1218f532906 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.512016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.512537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.512816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.513093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.516256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8ae3-2bd8-479b-8dde-8a84d649e39f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.521664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:24.523153 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:24.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:24.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:24.542126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 430/860] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:47:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:24.544287 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:24.549812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.566576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.566906 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.567201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.568030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.572803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:24.572803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:24.579717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:24.580769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:24.581768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:24.586061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 431/861] 10.222.0.58 () {56 vars in 1132 bytes} [Sun Aug 28 00:47:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:24.587451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:24.605709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.677656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde1d94-5e63-4640-9bba-c80243976d5c None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.716977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.718225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b31a6d-553a-4169-94b5-12c0e2b35e95 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.718927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.719435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.720064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.721134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:24.721697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:24.723495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:24.745699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 431/862] 10.222.0.58 () {56 vars in 1149 bytes} [Sun Aug 28 00:47:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:24.751949 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:24.760987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.761611 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.761886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.762209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.763073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:24.763285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:24.764659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:24.775696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 432/863] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:24.777050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:24.822743 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.869440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d5ea2-d295-4390-94ac-6c0bc3378d18 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.874457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:24.897483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3dde-9c3c-46ec-a622-e0d2b8006a89 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:24.923814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.924797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.925367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.925938 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.934847 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:24.935517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:24.935794 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:24.936066 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:24.936709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:24.937010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:24.938509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:24.944119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 433/864] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:25.019039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:25.019039 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:25.084105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:25.131884 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 432/865] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:47:25.137541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:25.250406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d4cd2-f592-4a72-b8f7-230c443d21de None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:25.288463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:25.289445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:25.289946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:25.290419 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:25.302390 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:25.304249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:25.306405 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:25.320766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:25.324704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:25.325662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:25.325662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:25.325662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:25.325662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 434/866] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:25.329992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:25.440015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093812f-ad50-4197-8ada-4bc5f14cad52 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:25.479599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e61d-adf1-4d3f-bc18-f12f0acdc524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:25.480562 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e61d-adf1-4d3f-bc18-f12f0acdc524 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:25.481072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e61d-adf1-4d3f-bc18-f12f0acdc524 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:25.481550 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e61d-adf1-4d3f-bc18-f12f0acdc524 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:25.482409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e61d-adf1-4d3f-bc18-f12f0acdc524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:25.482916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e61d-adf1-4d3f-bc18-f12f0acdc524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:25.484511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e61d-adf1-4d3f-bc18-f12f0acdc524 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:25.498029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 433/867] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:25.503788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:25.531068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd4fa9-27ff-4f17-9377-0fc58a67d1ec None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:25.531724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd4fa9-27ff-4f17-9377-0fc58a67d1ec None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:25.532202 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd4fa9-27ff-4f17-9377-0fc58a67d1ec None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:25.533823 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 434/868] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:25.540402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715048e-bbc2-44cc-89b1-ad3f920049f1 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:25.540965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715048e-bbc2-44cc-89b1-ad3f920049f1 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:25.541463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715048e-bbc2-44cc-89b1-ad3f920049f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:25.562380 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e715048e-bbc2-44cc-89b1-ad3f920049f1 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:25.564018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e715048e-bbc2-44cc-89b1-ad3f920049f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:25.584290 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:25.620128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cc8f-3742-4c35-a397-8c1c559044e7 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:25.659785 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:25.660423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:25.660700 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:25.660962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:25.674810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 435/869] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:25.679391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:25.681077 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:25.694766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:25.695767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:25.696677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:25.699320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 435/870] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:25.709178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715048e-bbc2-44cc-89b1-ad3f920049f1 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:25.812175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715048e-bbc2-44cc-89b1-ad3f920049f1 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:25.848264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:25.849316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:25.849824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:25.850314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:25.851235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:25.851744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:25.853391 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:25.867121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 436/871] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:25.875310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:25.933889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:25.981182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:25.982603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905b969-e7db-4576-a4bd-e074f59dfef4 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:25.995766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:26.021697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3358872-8e05-4548-831e-4136418a9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:26.022315 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3358872-8e05-4548-831e-4136418a9511 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.022597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3358872-8e05-4548-831e-4136418a9511 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.022870 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3358872-8e05-4548-831e-4136418a9511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.023637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3358872-8e05-4548-831e-4136418a9511 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=22cbba46308046d7b15f6f3a14e9eab6) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:26.023948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3358872-8e05-4548-831e-4136418a9511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:26.025388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3358872-8e05-4548-831e-4136418a9511 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:26.031728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 436/872] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:25 2022] GET /identity/v3/role_assignments?user.id=22cbba46308046d7b15f6f3a14e9eab6&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:26.035137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42daca-2582-4438-af78-8ec310a795cd None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.035137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42daca-2582-4438-af78-8ec310a795cd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.035137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42daca-2582-4438-af78-8ec310a795cd None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.035137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 437/873] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:26.040407 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762372cc-e6a3-46fd-96ba-05767baa0091 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.040689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762372cc-e6a3-46fd-96ba-05767baa0091 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.040955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762372cc-e6a3-46fd-96ba-05767baa0091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.064476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-762372cc-e6a3-46fd-96ba-05767baa0091 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:26.065624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-762372cc-e6a3-46fd-96ba-05767baa0091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:26.095335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ee19-11ed-4498-a04f-df264c044066 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:26.136751 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:26.137677 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.138291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.138645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.139931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:26.141499 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:26.163209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 438/874] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:26.229428 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 437/875] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:25 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:47:26.446588 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762372cc-e6a3-46fd-96ba-05767baa0091 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:26.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:26.558417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762372cc-e6a3-46fd-96ba-05767baa0091 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:26.602488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:26.603540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.604021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.604542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.605325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:26.606893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:26.617104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:26.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:26.619013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:26.621881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 439/876] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:26.628014 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:26.707492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:26.741128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d3554-9f05-48e3-bd67-bfcc07aa2584 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:26.777535 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dedda0-be53-4094-8691-95a4f5584036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:26.778153 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dedda0-be53-4094-8691-95a4f5584036 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.778428 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dedda0-be53-4094-8691-95a4f5584036 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.778696 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dedda0-be53-4094-8691-95a4f5584036 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.779350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dedda0-be53-4094-8691-95a4f5584036 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:26.779650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dedda0-be53-4094-8691-95a4f5584036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:26.781010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dedda0-be53-4094-8691-95a4f5584036 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:26.787371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 438/877] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:26.792742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:26.901715 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1136fd3-a326-4e01-a21f-d618bc76b86d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:26.915467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:26.937619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3f6d4-d1c5-43e1-aa8c-d2f5d5535374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:26.938230 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3f6d4-d1c5-43e1-aa8c-d2f5d5535374 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:26.939562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3f6d4-d1c5-43e1-aa8c-d2f5d5535374 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:26.939562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3f6d4-d1c5-43e1-aa8c-d2f5d5535374 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:26.939562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3f6d4-d1c5-43e1-aa8c-d2f5d5535374 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:26.939795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3f6d4-d1c5-43e1-aa8c-d2f5d5535374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:26.941054 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3f6d4-d1c5-43e1-aa8c-d2f5d5535374 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:26.946609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 440/878] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:27.076571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ac9a3-d31c-4d0e-96ba-2c93568fb185 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:27.077263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ac9a3-d31c-4d0e-96ba-2c93568fb185 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:27.077263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ac9a3-d31c-4d0e-96ba-2c93568fb185 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:27.078740 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 439/879] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:27.092527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8023d-5f67-4f0f-9de5-c57ae2ed0e03 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:27.092845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8023d-5f67-4f0f-9de5-c57ae2ed0e03 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:27.093087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8023d-5f67-4f0f-9de5-c57ae2ed0e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:27.124189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-36c8023d-5f67-4f0f-9de5-c57ae2ed0e03 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:27.125403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-36c8023d-5f67-4f0f-9de5-c57ae2ed0e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:27.205298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 441/880] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:27 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:27.588242 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ac9a3-d31c-4d0e-96ba-2c93568fb185 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:27.698498 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ac9a3-d31c-4d0e-96ba-2c93568fb185 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:27.735559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bc8d9-f2b4-49cc-aecb-87ae6e7ece3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:27.736167 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bc8d9-f2b4-49cc-aecb-87ae6e7ece3e None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:27.736442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bc8d9-f2b4-49cc-aecb-87ae6e7ece3e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:27.736708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bc8d9-f2b4-49cc-aecb-87ae6e7ece3e None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:27.737355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bc8d9-f2b4-49cc-aecb-87ae6e7ece3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:27.738721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bc8d9-f2b4-49cc-aecb-87ae6e7ece3e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:27.742981 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:27.852962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 440/881] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:27 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:28.250331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5e89-702b-4562-9bce-34e785c7e394 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:28.250851 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5e89-702b-4562-9bce-34e785c7e394 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:28.250851 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5e89-702b-4562-9bce-34e785c7e394 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:28.252366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 442/882] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:28.265044 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54e68-937a-4b33-a779-d2ebeb327905 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:28.266452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54e68-937a-4b33-a779-d2ebeb327905 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:28.267209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54e68-937a-4b33-a779-d2ebeb327905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:28.269500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60518196-db39-41c6-bbef-bc8e9d0a298e None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:28.269500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60518196-db39-41c6-bbef-bc8e9d0a298e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:28.269500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60518196-db39-41c6-bbef-bc8e9d0a298e None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:28.270095 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 443/883] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:28.276034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77472-dddd-4ffb-925d-f408fec74fd9 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:28.276617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77472-dddd-4ffb-925d-f408fec74fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:28.277094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77472-dddd-4ffb-925d-f408fec74fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:28.295475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-dab77472-dddd-4ffb-925d-f408fec74fd9 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:28.296575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-fdc54e68-937a-4b33-a779-d2ebeb327905 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:28.297238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-dab77472-dddd-4ffb-925d-f408fec74fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:28.298431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-fdc54e68-937a-4b33-a779-d2ebeb327905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:28.389708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 444/885] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:28.389934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 441/885] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:28.656065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54e68-937a-4b33-a779-d2ebeb327905 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:28.659299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77472-dddd-4ffb-925d-f408fec74fd9 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:28.711495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:28.768900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54e68-937a-4b33-a779-d2ebeb327905 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:28.792507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:28.805334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77472-dddd-4ffb-925d-f408fec74fd9 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:28.808225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:28.809176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:28.809656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:28.810140 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:28.810929 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:28.812548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:28.822889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:28.823946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:28.824797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:28.832416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 442/886] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:28.834246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:28.849834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:28.850472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:28.850748 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:28.851017 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:28.864299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:28.871233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:28.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:28.873127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:28.879243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 445/887] 10.222.0.58 () {56 vars in 1120 bytes} [Sun Aug 28 00:47:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:28.882717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:28.966472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2aa2-df98-47a1-875d-4312c474c7a2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.001808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:29.012271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11abbb-353f-422a-b80b-0d7950f13a85 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.018318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.019133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.019538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.019987 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.021335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:29.021752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.024041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.033046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 443/888] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:29.039444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.057297 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb82ff-8b79-4162-a561-33ffd4c9fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.058015 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb82ff-8b79-4162-a561-33ffd4c9fb9f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.058404 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb82ff-8b79-4162-a561-33ffd4c9fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.058837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb82ff-8b79-4162-a561-33ffd4c9fb9f None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.059636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb82ff-8b79-4162-a561-33ffd4c9fb9f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:29.059938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb82ff-8b79-4162-a561-33ffd4c9fb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.061367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb82ff-8b79-4162-a561-33ffd4c9fb9f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.074185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 446/889] 10.222.0.58 () {56 vars in 1115 bytes} [Sun Aug 28 00:47:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:29.075693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbfc8e-2f25-4cfe-93b4-8d6c224025f3 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.076156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbfc8e-2f25-4cfe-93b4-8d6c224025f3 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.076632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbfc8e-2f25-4cfe-93b4-8d6c224025f3 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.082361 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 447/890] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:29.083963 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d60d3-1d9b-4803-91db-1d79c945fef0 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.084246 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d60d3-1d9b-4803-91db-1d79c945fef0 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.084519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d60d3-1d9b-4803-91db-1d79c945fef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.097248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:29.104474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-8e0d60d3-1d9b-4803-91db-1d79c945fef0 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:29.108882 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-8e0d60d3-1d9b-4803-91db-1d79c945fef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:29.157504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a29aa8-5858-42bf-a09b-77b3f9e3e869 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.180728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 448/891] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:29.181595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d60d3-1d9b-4803-91db-1d79c945fef0 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.195873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.196774 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.197285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.197725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.198637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:29.198941 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.200351 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.206083 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 444/892] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:29.216455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.290450 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:29.312755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d60d3-1d9b-4803-91db-1d79c945fef0 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.349831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35d98-5b3a-4936-b512-2ea120b892e5 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.352119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.353037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.353516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.353988 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.364809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:29.366285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.367975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:29.384681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:29.385826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:29.386724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:29.386724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:29.386724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:29.393303 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 449/893] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:29.394898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.396652 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.397585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.398148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.398687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.399746 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] RBAC: Adding query filter params (interface=public, service_id=da9a487e05604516a6887345a5b24014, region_id=RegionOne) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:29.400283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.401872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.412999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 445/894] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:47:29 2022] GET /identity/v3/endpoints?service_id=da9a487e05604516a6887345a5b24014&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:29.414495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.508517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc937b3d-6766-4973-8bcb-6465747045e3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.536710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275819f-bd35-4c01-8fa5-357e203c5aca None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.545704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.546249 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.546515 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.546788 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.547472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:29.547779 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.549137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.552668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:29.562602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 450/895] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:29.563365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.579891 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.580714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.580997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.581267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.581915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.583297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.589404 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 446/896] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:29 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:47:29.590305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.640662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:29.708687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b6c2-f0ca-44a7-aa46-a441a377b89c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.710040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de7284-970f-4f29-9689-bf291259b378 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.748708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.749385 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.749664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.749938 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.751079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff499-17b3-4098-9f5f-07aba8d0b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.752073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff499-17b3-4098-9f5f-07aba8d0b66c None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.752678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff499-17b3-4098-9f5f-07aba8d0b66c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.753156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff499-17b3-4098-9f5f-07aba8d0b66c None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.753857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff499-17b3-4098-9f5f-07aba8d0b66c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.756118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff499-17b3-4098-9f5f-07aba8d0b66c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.761000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.761312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:29.775040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:29.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:29.781148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 447/897] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:47:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:29.782909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:29.845493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 451/898] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:29 2022] POST /identity/v3/services => generated 241 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:29.921224 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:29.921823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8299-7b3f-43cb-92f8-2ffce4f49de6 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.922114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8299-7b3f-43cb-92f8-2ffce4f49de6 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.922399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8299-7b3f-43cb-92f8-2ffce4f49de6 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.925344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 452/899] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:29.928197 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b67b8-455a-4c9b-8477-845c7dfc631d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:29.931637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25191af-6f71-424f-ae87-ae3d492b2914 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.931966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25191af-6f71-424f-ae87-ae3d492b2914 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.932200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25191af-6f71-424f-ae87-ae3d492b2914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.951853 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c25191af-6f71-424f-ae87-ae3d492b2914 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:29.953095 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c25191af-6f71-424f-ae87-ae3d492b2914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:29.986894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:29.987585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:29.988400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:29.988678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:29.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:29.991152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:29.992744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.014649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 448/900] 10.222.0.58 () {56 vars in 1149 bytes} [Sun Aug 28 00:47:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:30.021360 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.038807 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.055953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 453/901] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:30.142238 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a9b0-6add-4ea2-9a4c-a581e8e3b945 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.177975 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.178868 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.179354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.179765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.204702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.250142 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:30.251697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.359079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 449/902] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:30.364897 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25191af-6f71-424f-ae87-ae3d492b2914 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.379090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.447578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.490172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25191af-6f71-424f-ae87-ae3d492b2914 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.506295 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8882-5632-4716-8214-96f774388b34 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.527727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.528408 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.528679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.528945 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.539746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:30.541198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.549869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.550951 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.552105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.552392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.552983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:30.554355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:30.557141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:30.558277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:30.559332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:30.559332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:30.559332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:30.563172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 454/903] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:30.563484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:30.565279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:30.567077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:30.567998 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.571205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 450/904] 10.222.0.58 () {56 vars in 1132 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:30.571205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.609627 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.681264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d69e-cdf9-4a73-bdb1-c0fafc0d9895 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.684988 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2bbfd-a5ba-4090-9c8d-c52459ac2536 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.701308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.720697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.721558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.721986 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.722420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.723699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:30.724378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:30.726069 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.729072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.729679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.729956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.730484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.731163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:30.731473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:30.737416 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.737686 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 451/905] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:30.738777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.755180 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 455/906] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:30.757306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.862969 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:30.868539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a2079-14eb-432c-90e1-fa2850185dbd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.877618 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a726435-7b05-4cc9-a431-1e5903da2f5b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:30.905777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.906804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.907374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.907888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.915900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:30.917940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.919629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:30.920498 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:30.920777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:30.921044 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:30.922046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:30.922362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:30.923740 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:30.931134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 452/907] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:30.935811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:30.938032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:30.938952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:30.939889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 456/908] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:30.946709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:31.006255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:31.058107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae0a65-7a35-47bd-af60-a76ae7f63c60 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:31.089694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe41de-9e01-402c-ac0d-6b4427da61d5 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:31.099082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:31.099761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.100038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.100304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.101029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:31.101300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:31.102728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:31.120262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 457/909] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:31.121833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:31.140926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:31.142019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.142909 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:31.143321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.143888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.144770 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] RBAC: Adding query filter params (interface=public, service_id=bf9a9d4947ac4a4892f323b43382f644, region_id=RegionOne) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:31.145878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:31.150366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:31.158318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 453/910] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:47:30 2022] GET /identity/v3/endpoints?service_id=bf9a9d4947ac4a4892f323b43382f644&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:31.164124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:31.239667 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452f65b-98b4-424d-ac13-8b5009a83432 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:31.276567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac632d48-85d7-4338-aa29-94725d1c5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:31.277597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac632d48-85d7-4338-aa29-94725d1c5f7e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.278115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac632d48-85d7-4338-aa29-94725d1c5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.278601 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac632d48-85d7-4338-aa29-94725d1c5f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.279577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac632d48-85d7-4338-aa29-94725d1c5f7e None admin] RBAC: Adding query filter params (role.id=98690d641a3c4641a7aef40137e16cfc, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=22cbba46308046d7b15f6f3a14e9eab6) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:31.280087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac632d48-85d7-4338-aa29-94725d1c5f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:31.281776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac632d48-85d7-4338-aa29-94725d1c5f7e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:31.289064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 458/911] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:31 2022] GET /identity/v3/role_assignments?user.id=22cbba46308046d7b15f6f3a14e9eab6&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=98690d641a3c4641a7aef40137e16cfc => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:31.315464 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7c61-16f4-497c-9654-0e4ceeeaa67d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:31.328468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:31.357069 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01882e4b-78af-4478-9d39-7460a371d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:31.357695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01882e4b-78af-4478-9d39-7460a371d898 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.357978 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01882e4b-78af-4478-9d39-7460a371d898 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.358255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01882e4b-78af-4478-9d39-7460a371d898 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.358875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01882e4b-78af-4478-9d39-7460a371d898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:31.360302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01882e4b-78af-4478-9d39-7460a371d898 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:31.367608 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 454/912] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:31 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:47:31.662501 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bbbe4-6059-4bc4-b33b-a397cc9ff965 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.663016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bbbe4-6059-4bc4-b33b-a397cc9ff965 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.663016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bbbe4-6059-4bc4-b33b-a397cc9ff965 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.666697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 459/913] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:31.672797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f8027-2ce7-4efd-951d-d9b70ebecb3d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.673324 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f8027-2ce7-4efd-951d-d9b70ebecb3d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.673829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f8027-2ce7-4efd-951d-d9b70ebecb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.693419 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-f25f8027-2ce7-4efd-951d-d9b70ebecb3d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:31.694967 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-f25f8027-2ce7-4efd-951d-d9b70ebecb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:31.770479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 455/914] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:31.896841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829c51f-96bd-4d32-bde2-26896cbaf17e None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.897499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829c51f-96bd-4d32-bde2-26896cbaf17e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.897991 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829c51f-96bd-4d32-bde2-26896cbaf17e None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.899951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 460/915] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:31.905053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df816e9-b004-4fb1-9585-d7fd4f758955 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:31.905339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df816e9-b004-4fb1-9585-d7fd4f758955 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:31.905612 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df816e9-b004-4fb1-9585-d7fd4f758955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:31.924272 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0df816e9-b004-4fb1-9585-d7fd4f758955 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:31.925374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0df816e9-b004-4fb1-9585-d7fd4f758955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:31.995303 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 456/916] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:32.057503 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829c51f-96bd-4d32-bde2-26896cbaf17e None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.146862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:32.167019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829c51f-96bd-4d32-bde2-26896cbaf17e None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.207510 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.209262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.209760 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.210255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.211052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.212571 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:32.221937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:32.223175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:47:32.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:32.226958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 461/917] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:32.232779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df816e9-b004-4fb1-9585-d7fd4f758955 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.268194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:32.286833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.349904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df816e9-b004-4fb1-9585-d7fd4f758955 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.403456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.404076 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.404341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.404725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.405483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:32.405789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.407316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.408811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac88907-22b3-4a15-8a4c-0a61e5d420a7 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.417706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 457/918] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:32.418964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.453983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.455153 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.455628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.456044 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.457062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.460185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:32.474526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:32.475625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:32.476456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 462/919] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:32.482091 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.497185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:32.538053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:32.542488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b6ec-e574-4d16-98d0-2a1b90ddaa58 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.583242 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.584270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.584673 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.585089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.585788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:32.586161 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.587864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.593995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad3712-2644-4b92-a27c-a4a0117500ac None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.598407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 458/920] 10.222.0.58 () {56 vars in 1114 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:32.599718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.631855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.632459 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.632730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.633099 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.633819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:32.634121 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.635656 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.645451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 463/921] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:32.646466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c649864-53e9-4f27-b008-6dc130eec7d1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.726002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:32.752776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8ea6-19ff-4b76-837a-38162de9e217 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.761026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.761712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.762048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.762330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.763129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.764619 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.790419 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.794452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.794452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.794452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:32.794452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.794452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.799430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 464/922] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:32.807195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:32.835338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 459/923] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:32.928875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540f15e-bcd0-4244-abbe-1773a4ea1361 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:32.975179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc05c2-fc1e-41da-b76c-ba18fd725b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:32.975735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc05c2-fc1e-41da-b76c-ba18fd725b65 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:32.976020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc05c2-fc1e-41da-b76c-ba18fd725b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:32.976279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc05c2-fc1e-41da-b76c-ba18fd725b65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:32.976995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc05c2-fc1e-41da-b76c-ba18fd725b65 None admin] RBAC: Adding query filter params (interface=public, service_id=a6c233979aa340b0b44c80a76a729767, region_id=RegionOne) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:32.977298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc05c2-fc1e-41da-b76c-ba18fd725b65 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:32.978759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc05c2-fc1e-41da-b76c-ba18fd725b65 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:32.980846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:32.988591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 465/924] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/endpoints?service_id=a6c233979aa340b0b44c80a76a729767&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:32.996577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:33.019701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:33.113369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c9702-8802-4bcf-b050-c7e9c7d0d770 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:33.153742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fde52-2e3b-471d-bbc3-586f6989d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:33.154353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fde52-2e3b-471d-bbc3-586f6989d99e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.154629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fde52-2e3b-471d-bbc3-586f6989d99e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.154900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fde52-2e3b-471d-bbc3-586f6989d99e None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.155551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fde52-2e3b-471d-bbc3-586f6989d99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:33.156918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fde52-2e3b-471d-bbc3-586f6989d99e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:33.164317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 460/925] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:32 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:47:33.374783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894c2f3-f0c1-4832-a21a-e39ff98b02cd None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.375193 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894c2f3-f0c1-4832-a21a-e39ff98b02cd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.375378 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894c2f3-f0c1-4832-a21a-e39ff98b02cd None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.376820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 466/926] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:33.382650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85957-b46c-4a81-b34c-0cbcd8629be5 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.382943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85957-b46c-4a81-b34c-0cbcd8629be5 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.383256 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85957-b46c-4a81-b34c-0cbcd8629be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.405747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3cb85957-b46c-4a81-b34c-0cbcd8629be5 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:33.406947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3cb85957-b46c-4a81-b34c-0cbcd8629be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:33.412438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2416-0582-4320-832a-0933ea766f51 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.412714 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2416-0582-4320-832a-0933ea766f51 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.412986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2416-0582-4320-832a-0933ea766f51 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.414608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 467/927] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:33.420304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c8f7-06be-4ab0-9ba8-c62bb67f976e None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.420590 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c8f7-06be-4ab0-9ba8-c62bb67f976e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.420867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c8f7-06be-4ab0-9ba8-c62bb67f976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.440190 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-d6e0c8f7-06be-4ab0-9ba8-c62bb67f976e None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:33.441585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d6e0c8f7-06be-4ab0-9ba8-c62bb67f976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:33.480859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 461/928] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:33.514440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 468/929] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:33.760909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb85957-b46c-4a81-b34c-0cbcd8629be5 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:33.776326 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:33.792029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0c8f7-06be-4ab0-9ba8-c62bb67f976e None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:33.873340 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb85957-b46c-4a81-b34c-0cbcd8629be5 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:33.909146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:33.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.910053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.910322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.911465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:33.912967 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:33.922215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:33.923188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:33.924124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 462/930] 10.222.0.58 () {56 vars in 1132 bytes} [Sun Aug 28 00:47:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:33.929213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0c8f7-06be-4ab0-9ba8-c62bb67f976e None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:33.932118 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:33.961541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:33.970570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:33.971551 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:33.971833 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:33.974676 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:33.985353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:33.992119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:33.993086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:33.993956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:33.997028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 469/931] 10.222.0.58 () {56 vars in 1120 bytes} [Sun Aug 28 00:47:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:34.002330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:34.034099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:34.059369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80848b64-8b48-49f0-abcf-02df963e6247 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.097377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.098003 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.098841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.099210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.099842 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:34.100142 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.101523 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.111463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 463/932] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:34.112341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:34.127883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ca78-977d-4efc-8257-1077c52ddf91 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.167688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.168547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.169001 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.169434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.170255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:34.170757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.172453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.187392 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 470/933] 10.222.0.58 () {56 vars in 1115 bytes} [Sun Aug 28 00:47:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:34.188496 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:34.224515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff79f5-d1f0-470e-93ed-7b2597429df2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.252765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:34.274115 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.275361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.275863 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.276414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.278055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:34.278515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.280113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.292626 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 464/934] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:34.293664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:34.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:34.327737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7b3a3-e50d-4d4d-b5b3-f1e50b7899bf None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.378624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.379661 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.380904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.381338 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.396423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.398852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:34.418826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:34.419869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:34.420886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:34.420886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:34.420886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:34.420886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 471/935] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:34.427951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:34.429082 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57649-fa4a-4a45-8732-e444dd9c4038 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.466631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.467278 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.467558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.467829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.468492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.469922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.547438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082440d-086c-476e-b882-c4bf5006d5ed None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.549014 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:34.567398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 465/936] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:34.603654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.604292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.604644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.604923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.605649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:34.605952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.607478 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.623405 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 472/937] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:34.629088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:34.702722 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:34.756088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e7982-2871-4d1d-a5ad-8b4130c42da3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.795552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f379b8-3a07-4899-a612-866985e55297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.796184 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f379b8-3a07-4899-a612-866985e55297 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.796465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f379b8-3a07-4899-a612-866985e55297 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.796736 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f379b8-3a07-4899-a612-866985e55297 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.805415 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f379b8-3a07-4899-a612-866985e55297 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.806876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f379b8-3a07-4899-a612-866985e55297 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-b3f379b8-3a07-4899-a612-866985e55297 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:34.819510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:34.820534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:34.821497 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 466/938] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:47:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:34.831048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:34.934442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41133a-7255-457b-9f69-d1afdfb2afae None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.934792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41133a-7255-457b-9f69-d1afdfb2afae None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.934978 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41133a-7255-457b-9f69-d1afdfb2afae None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.936584 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 467/939] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:34.940342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135aba7-48b4-4a89-aa3f-c95b35c05257 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:34.941471 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d513f-a8b6-4dc6-830b-687795e3ee8c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.941781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d513f-a8b6-4dc6-830b-687795e3ee8c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.942114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d513f-a8b6-4dc6-830b-687795e3ee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.960972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-be1d513f-a8b6-4dc6-830b-687795e3ee8c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:34.962098 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-be1d513f-a8b6-4dc6-830b-687795e3ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:34.987067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:34.988455 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:34.989212 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:34.989684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:34.991290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:34.991943 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:34.993886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.018450 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 473/940] 10.222.0.58 () {56 vars in 1149 bytes} [Sun Aug 28 00:47:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:35.024826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.043200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 468/941] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:35.045808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:35.137344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6340827-c47f-4743-9790-a4a0ecf24c04 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.175380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.177969 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.178450 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.178937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.187245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e03d6-1a11-4183-a147-6256e12e9020 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.187532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e03d6-1a11-4183-a147-6256e12e9020 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.187816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e03d6-1a11-4183-a147-6256e12e9020 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.191790 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.193260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 469/942] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:35.193932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.194977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423cbf-ab53-4f2f-bfb6-b6d2428c8e28 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.195297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423cbf-ab53-4f2f-bfb6-b6d2428c8e28 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.195577 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423cbf-ab53-4f2f-bfb6-b6d2428c8e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:35.211894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:35.213100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:35.214189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:35.214189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:35.214189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:35.215721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-39423cbf-ab53-4f2f-bfb6-b6d2428c8e28 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:35.216463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 474/943] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:35.221321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-39423cbf-ab53-4f2f-bfb6-b6d2428c8e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:35.222554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.275901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:35.297492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:35.311235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 470/944] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:35.330611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423cbf-ab53-4f2f-bfb6-b6d2428c8e28 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.340916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85aea6-2ae3-481a-a0fd-9fce43629629 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.378740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.380224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.380643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.381052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.381986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:35.382545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.384168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.398769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 475/945] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:35.404484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.435527 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423cbf-ab53-4f2f-bfb6-b6d2428c8e28 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.475166 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.475806 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.476105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.476376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.477327 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.478532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.481430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING keystone.server.flask.common [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 00:47:35.529430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.sql.core [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:47:35.529430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:47:35.529430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [parameters: {'id': '9524fcb3865b4d5eaaaebd1441fc31e0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:47:35.529430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81582) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:47:35.531347 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60251b21-80a3-4343-b0fc-62e822977738 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9524fcb3865b4d5eaaaebd1441fc31e0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9524fcb3865b4d5eaaaebd1441fc31e0. Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:47:35.547622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application result.read() Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 00:47:35.548656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application yield resource Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise self.value Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application session.commit() Aug 28 00:47:35.549828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:47:35.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:47:35.552382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application result.read() Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:47:35.553176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [parameters: {'id': '9524fcb3865b4d5eaaaebd1441fc31e0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.554051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:35.554873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9524fcb3865b4d5eaaaebd1441fc31e0. Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 471/946] 10.222.0.58 () {60 vars in 1140 bytes} [Sun Aug 28 00:47:35 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:35.556006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.579571 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:35.592037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.593201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.593885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.594301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.600075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:35.601953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.603540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:35.616859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:35.618068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:35.619019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:35.623203 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 476/947] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:35.623203 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.673089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5772-6476-489e-a055-c5408b387df6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.710035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.710679 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.711258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.718575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.720245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:35.732563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:35.733628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 472/948] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:35.734511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.754640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb5919-cc07-4c8d-94d6-ceeaa17f897a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.805016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.805650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.805920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.806189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.806821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.808170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:35.818123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:35.819445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:35.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:35.824152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 477/949] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:35.825214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.851853 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:35.857786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1032-a661-4db7-914f-da5b9d754b82 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.885534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:35.893539 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.894155 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.894490 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.894760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.896462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:35.896668 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.898079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:35.918935 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 473/950] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:35.920101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:35.935431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dd54d-66fd-490d-81ad-7616d4793ec9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:35.973639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:35.974241 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:35.974514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:35.974783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:35.975477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:35.975781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:35.977331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:36.003225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 478/951] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:36.003225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:36.045040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3684ba-2c0e-4005-b513-aa8233b23240 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:36.094425 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:36.095763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.096140 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.096468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.097186 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:36.097560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:36.100273 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:36.107163 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 474/952] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:36.114267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:36.132292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce83e-fda5-48fa-ae30-66e955970598 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:36.146170 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:36.151226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:36.177329 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:36.178022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.178300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.178576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/22cbba46308046d7b15f6f3a14e9eab6/roles/98690d641a3c4641a7aef40137e16cfc` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.182061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=22cbba46308046d7b15f6f3a14e9eab6, role_id=98690d641a3c4641a7aef40137e16cfc)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:36.183696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:36.245316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ec99e-5d8f-41c3-9aa4-a6a58d4a774e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:36.273636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 479/953] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:47:35 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/22cbba46308046d7b15f6f3a14e9eab6/roles/98690d641a3c4641a7aef40137e16cfc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:47:36.285106 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ce5b5-9cfa-4778-930a-631681b9a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:36.285781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ce5b5-9cfa-4778-930a-631681b9a239 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.287460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ce5b5-9cfa-4778-930a-631681b9a239 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.287460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ce5b5-9cfa-4778-930a-631681b9a239 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.287460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ce5b5-9cfa-4778-930a-631681b9a239 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:36.287742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ce5b5-9cfa-4778-930a-631681b9a239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:36.289146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ce5b5-9cfa-4778-930a-631681b9a239 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:36.302088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 475/954] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:36.308307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:36.437019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5d244-31b1-4f9d-82a2-256490ab1722 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:36.477825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8401b-8698-4c1c-980f-3f52ba22364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:36.478443 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8401b-8698-4c1c-980f-3f52ba22364f None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.478721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8401b-8698-4c1c-980f-3f52ba22364f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.478992 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8401b-8698-4c1c-980f-3f52ba22364f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.479709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8401b-8698-4c1c-980f-3f52ba22364f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:36.481176 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8401b-8698-4c1c-980f-3f52ba22364f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:36.577658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 480/955] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:36 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:36.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d88c9-7a79-4e9b-8516-89c8cd1e98f1 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.651917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d88c9-7a79-4e9b-8516-89c8cd1e98f1 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.651917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d88c9-7a79-4e9b-8516-89c8cd1e98f1 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.653675 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 476/956] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:36.659920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510b18-d746-4c31-ad96-b7e8a8d21c78 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:36.660244 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510b18-d746-4c31-ad96-b7e8a8d21c78 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:36.660586 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510b18-d746-4c31-ad96-b7e8a8d21c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:36.683486 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-9a510b18-d746-4c31-ad96-b7e8a8d21c78 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:36.684720 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-9a510b18-d746-4c31-ad96-b7e8a8d21c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:36.712221 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:36.770104 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 481/957] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:37.041741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d88c9-7a79-4e9b-8516-89c8cd1e98f1 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:37.133839 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:37.151839 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d88c9-7a79-4e9b-8516-89c8cd1e98f1 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:37.190997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:37.191656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:37.191933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:37.192200 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:37.192776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:37.194128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:37.203441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:37.204616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:37.205840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 477/958] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:37.211008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a510b18-d746-4c31-ad96-b7e8a8d21c78 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:37.329840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a510b18-d746-4c31-ad96-b7e8a8d21c78 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:37.367214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d2dfe-6f0d-4667-a84a-4d2e46eeeb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:37.367824 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d2dfe-6f0d-4667-a84a-4d2e46eeeb2d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:37.368096 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d2dfe-6f0d-4667-a84a-4d2e46eeeb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:37.368366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d2dfe-6f0d-4667-a84a-4d2e46eeeb2d None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:37.368999 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d2dfe-6f0d-4667-a84a-4d2e46eeeb2d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:37.369297 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d2dfe-6f0d-4667-a84a-4d2e46eeeb2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:37.370653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d2dfe-6f0d-4667-a84a-4d2e46eeeb2d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:37.379928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 482/959] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:37.382355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:37.490033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be51c1-b8a5-4f20-ae02-371291663449 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:37.528128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060063-00d3-4e31-8068-e5117ef8a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:37.528752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060063-00d3-4e31-8068-e5117ef8a104 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:37.529027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060063-00d3-4e31-8068-e5117ef8a104 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:37.529297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060063-00d3-4e31-8068-e5117ef8a104 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:37.529934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c060063-00d3-4e31-8068-e5117ef8a104 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:37.530234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c060063-00d3-4e31-8068-e5117ef8a104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:37.531635 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c060063-00d3-4e31-8068-e5117ef8a104 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:37.537944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 478/960] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:38.194267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e858-4cf3-4a7a-b9a6-a7993fe44bd3 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.194986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e858-4cf3-4a7a-b9a6-a7993fe44bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.195537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e858-4cf3-4a7a-b9a6-a7993fe44bd3 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.197395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 483/961] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:38.203239 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602852-98fa-4ea8-a0bc-2dc987a35ab5 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.204107 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602852-98fa-4ea8-a0bc-2dc987a35ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.204590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602852-98fa-4ea8-a0bc-2dc987a35ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.224565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c9602852-98fa-4ea8-a0bc-2dc987a35ab5 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:38.226415 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c9602852-98fa-4ea8-a0bc-2dc987a35ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:38.234642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:38.303357 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 479/962] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:38.336001 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf81f-99e6-423f-a10e-5314d6ec9cce None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.336519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf81f-99e6-423f-a10e-5314d6ec9cce None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.336519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf81f-99e6-423f-a10e-5314d6ec9cce None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.338126 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 484/963] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:38.343602 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864938-39d6-4640-8242-852239866a3e None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.343885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864938-39d6-4640-8242-852239866a3e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.344156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864938-39d6-4640-8242-852239866a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.362705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-16864938-39d6-4640-8242-852239866a3e None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:38.364270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-16864938-39d6-4640-8242-852239866a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:38.433561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 480/964] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:38.595932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf81f-99e6-423f-a10e-5314d6ec9cce None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:38.608282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365329a8-dab5-4c37-9fdb-b4b5483e95cb None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.608610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365329a8-dab5-4c37-9fdb-b4b5483e95cb None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.608845 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365329a8-dab5-4c37-9fdb-b4b5483e95cb None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.610345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 481/965] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:38.616333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb247694-fcc8-4a84-b506-6ba95dfa0f51 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.616612 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb247694-fcc8-4a84-b506-6ba95dfa0f51 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.616887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb247694-fcc8-4a84-b506-6ba95dfa0f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.619412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:38.642172 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-eb247694-fcc8-4a84-b506-6ba95dfa0f51 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:38.644248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-eb247694-fcc8-4a84-b506-6ba95dfa0f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:38.729212 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf81f-99e6-423f-a10e-5314d6ec9cce None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:38.742687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 482/966] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:38.748016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb247694-fcc8-4a84-b506-6ba95dfa0f51 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:38.750835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:38.769550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:38.770511 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.770787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.771056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.771735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:38.773180 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:38.775886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING keystone.server.flask.common [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 00:47:38.832636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.sql.core [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:47:38.832636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:47:38.832636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [parameters: {'user_id': '86054b30fb3e49dc996a5d3fcdbf53df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:47:38.832636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result.read() Aug 28 00:47:38.840682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:47:38.845616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application yield resource Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise self.value Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application session.commit() Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:47:38.846684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:47:38.847658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:47:38.849330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application result.read() Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:47:38.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [parameters: {'user_id': '86054b30fb3e49dc996a5d3fcdbf53df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:38.852693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 00:47:38.854630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 485/967] 10.222.0.58 () {60 vars in 1131 bytes} [Sun Aug 28 00:47:38 2022] POST /identity/v3/users => generated 160 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:38.857267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:38.882130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb247694-fcc8-4a84-b506-6ba95dfa0f51 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:38.920856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:38.921885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:38.922444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:38.922929 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:38.935558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:38.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:38.941980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:38.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:38.945197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:38.951738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 483/968] 10.222.0.58 () {56 vars in 1120 bytes} [Sun Aug 28 00:47:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:38.953082 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:38.963509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e697-8ba2-4e1e-845a-f110d1168bdd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.002819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754032-691e-4252-8274-9599d680d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.003621 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754032-691e-4252-8274-9599d680d450 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.003903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754032-691e-4252-8274-9599d680d450 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.004289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754032-691e-4252-8274-9599d680d450 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.012727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754032-691e-4252-8274-9599d680d450 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.014606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754032-691e-4252-8274-9599d680d450 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.028381 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1a754032-691e-4252-8274-9599d680d450 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:39.029354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:39.030473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:39.031955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 486/969] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:39.032719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754032-691e-4252-8274-9599d680d450 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.078617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13119f-c025-4cb1-85b6-270b9295a447 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.118102 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.118635 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.118912 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.119214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.119889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:39.120188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.121571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.130796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 484/970] 10.222.0.58 () {56 vars in 1115 bytes} [Sun Aug 28 00:47:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:39.137201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.148493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754032-691e-4252-8274-9599d680d450 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.187602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.188242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.188527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.188801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.189400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.190780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:39.200614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:39.201884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:39.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 487/971] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:39.209507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.213980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.252513 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb652-c40b-4796-a1c0-c63d98ca9e52 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.277723 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.289598 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.290220 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.290503 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.290775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.291508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:39.291814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.293246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.326746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50538bfe-9684-4b01-bcc8-32a30bd66bdd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.330134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 485/972] 10.222.0.58 () {56 vars in 1101 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:39.330825 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.376826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.377373 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.377662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.377926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.390227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.391784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:39.409427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:39.410821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:39.411914 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:39.411914 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:39.411914 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:39.415950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 488/973] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:39.416936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.484819 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fadc0a-e50d-4250-b1a9-a7d18002e5c8 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.491570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.537156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77cb80-b494-4b8c-aea7-e4f02fd08d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.537794 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77cb80-b494-4b8c-aea7-e4f02fd08d86 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.538073 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77cb80-b494-4b8c-aea7-e4f02fd08d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.538347 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77cb80-b494-4b8c-aea7-e4f02fd08d86 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.538993 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77cb80-b494-4b8c-aea7-e4f02fd08d86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:39.539806 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77cb80-b494-4b8c-aea7-e4f02fd08d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.541613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77cb80-b494-4b8c-aea7-e4f02fd08d86 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.547988 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 486/974] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:39.549323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20a6e-70de-4805-a862-dc1ec960a1c7 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.549459 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670df1-31fa-4b48-8ae6-0ccc0a0f9b69 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.549647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20a6e-70de-4805-a862-dc1ec960a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.549887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20a6e-70de-4805-a862-dc1ec960a1c7 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.551888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 487/975] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:39.554449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20a6e-70de-4805-a862-dc1ec960a1c7 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.594611 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6fa03-739f-4166-b049-2409c96c8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.595367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6fa03-739f-4166-b049-2409c96c8508 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.595642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6fa03-739f-4166-b049-2409c96c8508 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.595919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6fa03-739f-4166-b049-2409c96c8508 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.596570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6fa03-739f-4166-b049-2409c96c8508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:39.597184 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6fa03-739f-4166-b049-2409c96c8508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.598923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6fa03-739f-4166-b049-2409c96c8508 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.615434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.616855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 489/976] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:39.618251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565f51-bfa7-480d-a96d-82eb2e56e817 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.618530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565f51-bfa7-480d-a96d-82eb2e56e817 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.618800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565f51-bfa7-480d-a96d-82eb2e56e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.638530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a2565f51-bfa7-480d-a96d-82eb2e56e817 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:39.640435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a2565f51-bfa7-480d-a96d-82eb2e56e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:39.678069 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d20a6e-70de-4805-a862-dc1ec960a1c7 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.713709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 490/977] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:39.713910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.714332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.714808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2565f51-bfa7-480d-a96d-82eb2e56e817 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.714936 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.715238 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.715828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:39.716127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.718556 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.729181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 488/978] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:39.730623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.764799 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.831029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2565f51-bfa7-480d-a96d-82eb2e56e817 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.837889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c627da4-72b2-461a-b542-ad16eef0840b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:39.853296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:39.870668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.871350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.871630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.871930 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.878781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:39.879646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:39.880003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.880133 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:39.880278 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:39.880993 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] RBAC: Adding query filter params (interface=admin, service_id=a6c233979aa340b0b44c80a76a729767, region_id=RegionOne) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:39.881299 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:39.882182 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.882657 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:39.888303 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 489/979] 10.222.0.58 () {56 vars in 1249 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/endpoints?service_id=a6c233979aa340b0b44c80a76a729767&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:39.893979 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:39.900900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:39.901881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:39.902872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 491/980] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:39.907787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:39.999908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eb382-86c7-47d8-9dbb-a9f8775ac02d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.015039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8708b0b-fc28-4209-98bd-59004c21472d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.022594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:40.034487 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.035105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.035990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.036287 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.037003 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.038373 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.044586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 490/981] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:47:40.045095 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:40.057468 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.058775 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.059382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.059872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.060948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:40.064022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.064022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.085750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 492/982] 10.222.0.58 () {56 vars in 1149 bytes} [Sun Aug 28 00:47:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:40.091432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:40.098867 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:40.167927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03d6d4-de42-43bf-8bc7-b0fa209c70f2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.204544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a2f3-a848-4264-af84-0b2ab04301f1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.210188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.210453 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.210722 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.211413 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.212783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.241662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.242269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.242542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.242812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.273761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:40.310773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.312264 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.331246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 491/983] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:40 2022] POST /identity/v3/services => generated 242 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:40.428738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 493/984] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:40 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:40.434951 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:40.543052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:40.555502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a37d6e-2795-43a3-ab8e-36fa71cb1431 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.593392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.594041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.594471 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.594590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.607021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.608502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:40.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:40.628901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:40.630013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:40.630013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:40.630013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:40.630013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 492/985] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:40.635447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:40.715311 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:40.757031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724fd6a-4449-4172-9805-e120584e1aab None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.794464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.795079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.795383 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.795649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.796312 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:40.796607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.797961 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.814957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 494/986] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:40.816642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:40.928275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9e37-5a8e-4c54-be59-00746503b0da None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:40.962712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:40.963375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:40.963656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:40.963927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:40.971135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:40.972522 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:40.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:40.985518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:40.991282 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 493/987] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:40.993250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:41.096752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d9de4-aef9-46de-a821-14dbbc04c6bb None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:41.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:41.131388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76f6f0-6a35-4760-add1-b07e930a0d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:41.132003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f6f0-6a35-4760-add1-b07e930a0d84 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:41.132281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f6f0-6a35-4760-add1-b07e930a0d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:41.132555 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f6f0-6a35-4760-add1-b07e930a0d84 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:41.133263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76f6f0-6a35-4760-add1-b07e930a0d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:41.133568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76f6f0-6a35-4760-add1-b07e930a0d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:41.134996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76f6f0-6a35-4760-add1-b07e930a0d84 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:41.153273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 495/988] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:41.155280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:41.166210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:41.261617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34702443-79ce-40c2-9b3d-3667f5a54c2a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:41.295574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55093-83e1-4401-9425-66c81ae5e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:41.296180 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55093-83e1-4401-9425-66c81ae5e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:41.296456 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55093-83e1-4401-9425-66c81ae5e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:41.296727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55093-83e1-4401-9425-66c81ae5e5b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:41.297446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55093-83e1-4401-9425-66c81ae5e5b2 None admin] RBAC: Adding query filter params (role.id=98690d641a3c4641a7aef40137e16cfc, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=22cbba46308046d7b15f6f3a14e9eab6) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:41.297750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55093-83e1-4401-9425-66c81ae5e5b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:41.299214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55093-83e1-4401-9425-66c81ae5e5b2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:41.311144 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 494/989] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:41 2022] GET /identity/v3/role_assignments?user.id=22cbba46308046d7b15f6f3a14e9eab6&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=98690d641a3c4641a7aef40137e16cfc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:42.000615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f43ed1-994c-4634-8de0-89f4f9758d88 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.001105 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f43ed1-994c-4634-8de0-89f4f9758d88 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.001105 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f43ed1-994c-4634-8de0-89f4f9758d88 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.002583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 496/990] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:42.008291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4878f-cbe8-4f57-85ea-979a44df3c80 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4878f-cbe8-4f57-85ea-979a44df3c80 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.008838 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4878f-cbe8-4f57-85ea-979a44df3c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.027448 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-8eb4878f-cbe8-4f57-85ea-979a44df3c80 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:42.028650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8eb4878f-cbe8-4f57-85ea-979a44df3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:42.095846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:42.103138 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 495/991] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:42.276402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e496542-b3c8-4444-a179-1c0523f50247 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.276760 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e496542-b3c8-4444-a179-1c0523f50247 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.276944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e496542-b3c8-4444-a179-1c0523f50247 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.278420 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 497/992] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:42.283463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23a62-1728-43a2-8574-9f65f9e75b6d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.283750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23a62-1728-43a2-8574-9f65f9e75b6d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.284023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23a62-1728-43a2-8574-9f65f9e75b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.302864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-6bb23a62-1728-43a2-8574-9f65f9e75b6d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:42.304092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6bb23a62-1728-43a2-8574-9f65f9e75b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:42.373068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e496542-b3c8-4444-a179-1c0523f50247 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.374866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 496/993] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:42.482191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e496542-b3c8-4444-a179-1c0523f50247 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:42.518305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:42.518953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.519261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.520076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:42.522005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:42.530795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:42.531843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:47:42.533243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:42.536776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 498/994] 10.222.0.58 () {56 vars in 1126 bytes} [Sun Aug 28 00:47:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:42.538010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb23a62-1728-43a2-8574-9f65f9e75b6d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.639516 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb23a62-1728-43a2-8574-9f65f9e75b6d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:42.641584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.678124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:42.684420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:42.685040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.685323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.685600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.686235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:42.686542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:42.687954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:42.698053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 497/995] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:42.699478 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:42.700369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.755543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae3cc6-4cbc-47bf-9575-a5126cb58722 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:42.793496 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:42.794491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.794947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.795421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.796305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:42.797954 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:42.807889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:42.808903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:42.809778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:42.812202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 499/996] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:42.812474 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5ba4-bf04-4f51-a5fc-9873d1e789f2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:42.818305 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.854806 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:42.855446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.855747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.855984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.857120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:42.857120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:42.858297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:42.863831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 498/997] 10.222.0.58 () {56 vars in 1122 bytes} [Sun Aug 28 00:47:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:42.869183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.932859 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34275c-726a-4ba0-a98f-09a315660cd2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:42.934735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:42.946911 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:42.969482 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:42.970213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:42.970492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:42.970764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:42.971489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:42.971791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:42.973202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:42.978245 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 500/998] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:42.983841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:42.992943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6470-39ee-4823-afcc-ad496f626cb1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:43.032647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:43.033278 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.033535 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.033824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.034549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:43.036161 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:43.090164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfde59c-9e0d-4d9f-b347-5d1e2c4282e6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:43.102432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 499/999] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:47:43.137037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de656103-3c37-4c08-8042-1e042d0ba975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:43.137656 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656103-3c37-4c08-8042-1e042d0ba975 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.137929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656103-3c37-4c08-8042-1e042d0ba975 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.138195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656103-3c37-4c08-8042-1e042d0ba975 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.138836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656103-3c37-4c08-8042-1e042d0ba975 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:43.139163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656103-3c37-4c08-8042-1e042d0ba975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:43.140584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656103-3c37-4c08-8042-1e042d0ba975 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:43.146356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 501/1000] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:43.152594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:43.268380 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98972a4-add3-4181-ac16-ba8490625e47 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:43.282754 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868d90d-c661-4312-8c9f-47e7c292d566 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.283052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868d90d-c661-4312-8c9f-47e7c292d566 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.283415 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868d90d-c661-4312-8c9f-47e7c292d566 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.284837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 502/1001] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:43.286900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:43.291057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47942e9-c708-4f05-bcc7-7b46a3ec8984 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.291377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47942e9-c708-4f05-bcc7-7b46a3ec8984 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.291662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47942e9-c708-4f05-bcc7-7b46a3ec8984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.315865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c47942e9-c708-4f05-bcc7-7b46a3ec8984 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:43.318253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c47942e9-c708-4f05-bcc7-7b46a3ec8984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:43.318840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:43.319526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.319810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.320120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.325915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] RBAC: Adding query filter params (interface=public, service_id=e9a4bd70d3d8471386cc284313218e87, region_id=RegionOne) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:43.325915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:43.325915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:43.328578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 500/1002] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:47:43 2022] GET /identity/v3/endpoints?service_id=e9a4bd70d3d8471386cc284313218e87&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:43.335122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:43.354876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:43.398177 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 503/1003] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:43.449769 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6326-a922-4a4f-99d9-58164fd627ee None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:43.485984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:43.486600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.486879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.487176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.487781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:43.489550 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:43.503428 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 501/1004] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:43 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:47:43.669487 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47942e9-c708-4f05-bcc7-7b46a3ec8984 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:43.771838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47942e9-c708-4f05-bcc7-7b46a3ec8984 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:43.806097 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:43.806737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.807014 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.807319 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.807904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:43.809758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:43.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:43.820678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:43.821541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 504/1005] 10.222.0.58 () {56 vars in 1105 bytes} [Sun Aug 28 00:47:43 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:43.828649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:43.877832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:43.937814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181076fd-332a-40dd-bd91-7b60163c0cde None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:43.973837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c66736-0da5-4041-beca-dabdad3d951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:43.974557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66736-0da5-4041-beca-dabdad3d951d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:43.974919 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66736-0da5-4041-beca-dabdad3d951d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:43.975222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66736-0da5-4041-beca-dabdad3d951d None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:43.975879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c66736-0da5-4041-beca-dabdad3d951d None admin] RBAC: Adding query filter params (name=image) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:43.976183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c66736-0da5-4041-beca-dabdad3d951d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:43.977550 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c66736-0da5-4041-beca-dabdad3d951d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:43.982843 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 502/1006] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:43.988769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:44.020766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:44.091315 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883ea1-75a6-4dcb-b5a6-4477422bb3f0 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:44.126147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004ebe-2725-4891-9130-7458dcb8c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:44.126757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004ebe-2725-4891-9130-7458dcb8c386 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:44.127027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004ebe-2725-4891-9130-7458dcb8c386 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:44.127335 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004ebe-2725-4891-9130-7458dcb8c386 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:44.127963 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47004ebe-2725-4891-9130-7458dcb8c386 None admin] RBAC: Adding query filter params (type=image) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:44.128259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47004ebe-2725-4891-9130-7458dcb8c386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:44.130163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47004ebe-2725-4891-9130-7458dcb8c386 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:44.142604 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 505/1007] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:45.172566 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd3ed-8a86-4601-9b44-3963b12a4ec7 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.173114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd3ed-8a86-4601-9b44-3963b12a4ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.173114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd3ed-8a86-4601-9b44-3963b12a4ec7 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.174469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 503/1008] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:45.180139 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f90b6-6f14-4f2c-b3ea-00c37d304be5 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.180575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f90b6-6f14-4f2c-b3ea-00c37d304be5 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.180692 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f90b6-6f14-4f2c-b3ea-00c37d304be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.199682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-f96f90b6-6f14-4f2c-b3ea-00c37d304be5 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:45.200867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-f96f90b6-6f14-4f2c-b3ea-00c37d304be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:45.275531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 506/1009] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:45 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:45.461926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208accd-52e9-4d68-bdfc-8075c7a67244 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.462120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208accd-52e9-4d68-bdfc-8075c7a67244 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.462389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208accd-52e9-4d68-bdfc-8075c7a67244 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.463904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 504/1010] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:45.469290 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba07d2-9d1d-4539-b190-9b95aa1fd06c None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.469576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba07d2-9d1d-4539-b190-9b95aa1fd06c None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.469851 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba07d2-9d1d-4539-b190-9b95aa1fd06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.488634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-deba07d2-9d1d-4539-b190-9b95aa1fd06c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:45.489826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-deba07d2-9d1d-4539-b190-9b95aa1fd06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:45.507685 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:45.544569 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208accd-52e9-4d68-bdfc-8075c7a67244 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:45.560732 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 507/1011] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:45 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:45.657088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208accd-52e9-4d68-bdfc-8075c7a67244 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:45.670547 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:45.694257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:45.694936 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.695219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.695488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.696605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:45.698033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:45.704396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 505/1012] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:45.705931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba07d2-9d1d-4539-b190-9b95aa1fd06c None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:45.811697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba07d2-9d1d-4539-b190-9b95aa1fd06c None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:45.831376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:45.848234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:45.848842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.849114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.849383 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.850036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:45.851477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:45.935946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8955a-573e-4fcc-b4dd-d0f2cfc21ed1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:45.939412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 508/1013] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:45 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:45.984553 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f46c55-979d-4c2a-af3c-0d68addeabf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:45.985264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46c55-979d-4c2a-af3c-0d68addeabf4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:45.985548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46c55-979d-4c2a-af3c-0d68addeabf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:45.985822 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46c55-979d-4c2a-af3c-0d68addeabf4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:45.986423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f46c55-979d-4c2a-af3c-0d68addeabf4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:45.987881 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f46c55-979d-4c2a-af3c-0d68addeabf4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-76f46c55-979d-4c2a-af3c-0d68addeabf4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:45.998395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:45.999536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:47:46.000412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:46.001879 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 506/1014] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:46.006537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:46.016540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:46.061697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074fd0-b444-4f6d-ac5a-ba23e4b905ff None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:46.062034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074fd0-b444-4f6d-ac5a-ba23e4b905ff None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:46.062245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074fd0-b444-4f6d-ac5a-ba23e4b905ff None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:46.063640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 507/1015] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:46.070042 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3a16-5cdd-4667-b98e-ff87977169ee None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:46.070319 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3a16-5cdd-4667-b98e-ff87977169ee None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:46.070588 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3a16-5cdd-4667-b98e-ff87977169ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:46.090694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e9bc3a16-5cdd-4667-b98e-ff87977169ee None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:46.091928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e9bc3a16-5cdd-4667-b98e-ff87977169ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:46.125894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58afa0-8f9b-45cf-8f8c-54e3e0ee2823 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:46.135737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:46.165274 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:46.165924 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:46.166202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:46.166474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:46.167141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:46.167447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:46.168816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:46.171984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 508/1016] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:46 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:46.179144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 509/1017] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:46.183569 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc3a16-5cdd-4667-b98e-ff87977169ee None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:46.290243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc3a16-5cdd-4667-b98e-ff87977169ee None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:46.324178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:46.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:46.324989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:46.325259 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:46.325965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:46.326273 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:46.327664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:46.337792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 509/1018] 10.222.0.58 () {56 vars in 1112 bytes} [Sun Aug 28 00:47:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:46.338755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:46.413353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:46.439878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:46.448793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a89b2-8e0c-45f9-acb5-8ce9cad80df1 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:46.483911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:46.485012 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd8ed9-1591-45a8-bea9-3cdd7a95e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:46.485990 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd8ed9-1591-45a8-bea9-3cdd7a95e3ba None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:46.486268 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd8ed9-1591-45a8-bea9-3cdd7a95e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:46.486548 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd8ed9-1591-45a8-bea9-3cdd7a95e3ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:46.487264 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd8ed9-1591-45a8-bea9-3cdd7a95e3ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:46.488757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd8ed9-1591-45a8-bea9-3cdd7a95e3ba None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:46.546956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 510/1019] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:46.554811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c67ee5-457e-49bc-93ff-8c9e58c96488 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:46.602897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52e196-1a75-4f38-929a-78628ab8b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:46.603469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e196-1a75-4f38-929a-78628ab8b44e None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:46.603748 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e196-1a75-4f38-929a-78628ab8b44e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:46.604015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e196-1a75-4f38-929a-78628ab8b44e None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:46.604732 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52e196-1a75-4f38-929a-78628ab8b44e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:46.606147 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52e196-1a75-4f38-929a-78628ab8b44e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:46.683161 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 510/1020] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:46 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:47:47.943485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab775f1-268a-48bf-9d4f-1ad448aeac31 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:47.943976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab775f1-268a-48bf-9d4f-1ad448aeac31 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:47.943976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab775f1-268a-48bf-9d4f-1ad448aeac31 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:47.945449 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 511/1021] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:47.950610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba024-67ca-427c-ad38-fbfa95404ad8 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:47.950991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba024-67ca-427c-ad38-fbfa95404ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:47.951180 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba024-67ca-427c-ad38-fbfa95404ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:47.970204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-b7aba024-67ca-427c-ad38-fbfa95404ad8 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:47.971423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-b7aba024-67ca-427c-ad38-fbfa95404ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:48.046584 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 511/1022] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:48.322176 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab775f1-268a-48bf-9d4f-1ad448aeac31 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:48.427591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab775f1-268a-48bf-9d4f-1ad448aeac31 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:48.454933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:48.465560 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829a1c9-0f03-438a-95e2-f4d1b0e5c57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:48.466198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a1c9-0f03-438a-95e2-f4d1b0e5c57f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.466491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a1c9-0f03-438a-95e2-f4d1b0e5c57f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.466783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a1c9-0f03-438a-95e2-f4d1b0e5c57f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.467973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829a1c9-0f03-438a-95e2-f4d1b0e5c57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:48.474865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829a1c9-0f03-438a-95e2-f4d1b0e5c57f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:48.474865 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 512/1023] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:48.478016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba024-67ca-427c-ad38-fbfa95404ad8 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:48.497832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:48.584641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba024-67ca-427c-ad38-fbfa95404ad8 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:48.596322 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f102-cf41-4db0-9305-d4a3d8635844 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.596623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f102-cf41-4db0-9305-d4a3d8635844 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.596872 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f102-cf41-4db0-9305-d4a3d8635844 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.599004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 513/1024] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:48.603902 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ab12-b169-4e39-8c12-515b1cf8812b None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.604183 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ab12-b169-4e39-8c12-515b1cf8812b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.604455 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ab12-b169-4e39-8c12-515b1cf8812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.622687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-1fc0ab12-b169-4e39-8c12-515b1cf8812b None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:48.623914 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-1fc0ab12-b169-4e39-8c12-515b1cf8812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:48.624983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:48.625596 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.625880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.626151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.626824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:48.628283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:48.693227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 514/1025] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:48.695583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468ae58-f65f-4aa0-9177-156bb1f4b718 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.695864 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468ae58-f65f-4aa0-9177-156bb1f4b718 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.696133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468ae58-f65f-4aa0-9177-156bb1f4b718 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.697406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 515/1026] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:48.702688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d0730-8d09-4e9c-b5a0-30fc25033840 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:48.702984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d0730-8d09-4e9c-b5a0-30fc25033840 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:48.703283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d0730-8d09-4e9c-b5a0-30fc25033840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:48.715755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 512/1027] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:47:48 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:47:48.727513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-0a6d0730-8d09-4e9c-b5a0-30fc25033840 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:48.728737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-0a6d0730-8d09-4e9c-b5a0-30fc25033840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:48.811135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 516/1028] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:48.961008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.040594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.066086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481fc49-3abb-473b-b33e-c9115f6f4ffb None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.079060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d0730-8d09-4e9c-b5a0-30fc25033840 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.103714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.104352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.104824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.106235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.117416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:49.122630 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:49.123840 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:49.124712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 513/1029] 10.222.0.58 () {56 vars in 1120 bytes} [Sun Aug 28 00:47:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:49.129666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.144638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.189727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d0730-8d09-4e9c-b5a0-30fc25033840 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.228886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.229447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.229726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.230006 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] PATH_INFO: `/v3/services/image` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.230594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.231994 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.239016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6432-851b-4311-867e-7bc85b3669d4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:49.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:49.242306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:49.243366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 517/1030] 10.222.0.58 () {56 vars in 1105 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:49.247973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.283629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.284243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.284520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.285383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.286060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:49.286363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.287777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.290434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 514/1031] 10.222.0.58 () {56 vars in 1115 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:49.304099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.382423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c6b92-44ff-4376-b2b0-508da536819f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.404740 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.420607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8190-af26-4e35-8946-6536c658c8a9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.422517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.423160 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.423442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.423713 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.424353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] RBAC: Adding query filter params (name=image) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:49.424655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.426074 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.431330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 518/1032] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:49.437119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.459636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.460273 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.460557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.460829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.471901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.474210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:49.489856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:49.491084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:49.492276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:49.492276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:49.492276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:49.492276 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 515/1033] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:49.496748 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.548409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.556143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16ef5b-4b1c-4865-95a8-6f19b31d32ed None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.595168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.595888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.596164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.596433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.597060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] RBAC: Adding query filter params (type=image) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:49.597910 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.599295 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.604731 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 519/1034] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:49.610751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.616068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3060b-6688-4e51-b6c8-faf399cfab92 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.649756 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.650363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.650638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.650908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.651588 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:49.651886 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.653249 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.671325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 516/1035] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:49.677606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.678125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.739532 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d15d2-85d3-4358-98d5-672045ddf059 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.777294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.777900 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.778224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.778432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.779153 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] RBAC: Adding query filter params (interface=public, service_id=356f05b83dfe4f938600c0cd80b86b33, region_id=RegionOne) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:49.779460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.780819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.788920 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be04b-c4ae-45ec-b506-11cd5a5604e6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.791265 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 520/1036] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/endpoints?service_id=356f05b83dfe4f938600c0cd80b86b33&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:49.793663 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.801585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.827352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.828000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.828269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.828539 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.837019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.838464 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:49.853321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:49.854433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:49.855481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 517/1037] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:49.860609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:49.910280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eeb35-79a4-41a0-8d57-32d7a7284f45 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:49.921363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:49.946933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:49.947583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:49.947870 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:49.948124 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:49.948743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:49.950082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:49.967130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 521/1038] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:47:49.979001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619207a4-c6b8-4e0b-ac9a-ebe50c791335 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:50.020537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:50.023948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:50.023948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:50.023948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:50.023948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:50.023948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:50.024486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:50.051583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 518/1039] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:47:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:50.052950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:50.163165 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4d58b-1120-48bf-82a0-75631de20447 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:50.197750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:50.198365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:50.198639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:50.198910 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:50.244206 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:50.270296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:50.271792 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:50.375463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 522/1040] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:50.381511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:50.413821 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:50.494156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741042-f8f4-48a5-95b9-5ac638acac83 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:50.528835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366de72-37f0-4fb8-9185-08d73ad6abe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:50.529475 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366de72-37f0-4fb8-9185-08d73ad6abe4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:50.529752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366de72-37f0-4fb8-9185-08d73ad6abe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:50.530022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366de72-37f0-4fb8-9185-08d73ad6abe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:50.540634 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366de72-37f0-4fb8-9185-08d73ad6abe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:50.542086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366de72-37f0-4fb8-9185-08d73ad6abe4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-5366de72-37f0-4fb8-9185-08d73ad6abe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:50.557420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:50.558395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:50.564520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:50.564520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:50.564520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:50.564520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 519/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:50.566919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:50.645812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:50.679237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d28ce-256f-430f-8b35-bf7966876e9f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:50.717392 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:50.718016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:50.718295 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:50.718566 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:50.719248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:50.719554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:50.721090 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:50.721758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965625d3-43a4-4151-b05e-32b1966d85b5 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:50.722041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965625d3-43a4-4151-b05e-32b1966d85b5 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:50.723086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965625d3-43a4-4151-b05e-32b1966d85b5 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:50.724815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 520/1042] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:50.729638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e7bf-24b7-41fc-836b-165aba47ffc6 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:50.729907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e7bf-24b7-41fc-836b-165aba47ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:50.730165 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e7bf-24b7-41fc-836b-165aba47ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:50.734846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 523/1043] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:50.740832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:50.751020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-6cf2e7bf-24b7-41fc-836b-165aba47ffc6 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:50.752244 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6cf2e7bf-24b7-41fc-836b-165aba47ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:50.828386 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 521/1044] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:50.853175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a05021-6cb5-4ef5-8893-196e431c3b40 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:50.887554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:50.888179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:50.888450 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:50.888717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:50.890718 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:50.896887 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:50.898248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:50.910010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:50.910941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:50.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 524/1045] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:50.917034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e7bf-24b7-41fc-836b-165aba47ffc6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:50.928319 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:51.018869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e7bf-24b7-41fc-836b-165aba47ffc6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:51.054713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:51.055358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.055636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.055907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.056683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:51.056995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:51.058496 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:51.078610 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 522/1046] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:51.080537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:51.106159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:51.179942 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:51.194153 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85c9e9-1e81-4cbd-b659-2d80fc84c351 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:51.212340 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f13f-695a-4aa3-aa29-6fd9be64c4d2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:51.231092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:51.231724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.232003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.232275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.233005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] RBAC: Adding query filter params (role.id=98690d641a3c4641a7aef40137e16cfc, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=d1cdc7db1f714849ba14a987d2412591) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:51.233310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:51.234742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:51.241310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 525/1047] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:51 2022] GET /identity/v3/role_assignments?user.id=d1cdc7db1f714849ba14a987d2412591&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=98690d641a3c4641a7aef40137e16cfc => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:51.248426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:51.249088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.249365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.249638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.262375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:51.268088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:51.269713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:51.270573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 523/1048] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:51.276306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:51.343683 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:51.392875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683698a9-2f06-4e4d-8b77-d28f19d68058 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:51.428291 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:51.428897 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.429172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.429440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.430155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:51.430403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:51.431781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:51.440753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 526/1049] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:51.447401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:51.549352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b85fc-ece1-470c-98e6-6f372316a124 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:51.575846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:51.584771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528fc60-9418-4467-b1eb-17109e69a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:51.585411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528fc60-9418-4467-b1eb-17109e69a135 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.585708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528fc60-9418-4467-b1eb-17109e69a135 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.585978 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528fc60-9418-4467-b1eb-17109e69a135 None admin] PATH_INFO: `/v3/users/eedd5c0f31a4466e959d5007886c8054` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.600950 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528fc60-9418-4467-b1eb-17109e69a135 None admin] RBAC: Authorizing `identity:get_user(user_id=eedd5c0f31a4466e959d5007886c8054)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:51.602404 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528fc60-9418-4467-b1eb-17109e69a135 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:51.609356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 524/1050] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:47:51 2022] GET /identity/v3/users/eedd5c0f31a4466e959d5007886c8054 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:51.610272 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:51.722737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37709fc-2589-4042-8afa-5a712996dbdb None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:51.743961 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:51.759495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:51.760108 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.760381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.760649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.829635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:51.831078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:51.921108 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c8b5-6426-41ad-9249-54a30bc5c70f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.921393 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c8b5-6426-41ad-9249-54a30bc5c70f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.921654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c8b5-6426-41ad-9249-54a30bc5c70f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.923000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 525/1051] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:51.928807 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7110b-1c4c-4071-bc38-f9b076e2a591 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:51.929083 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7110b-1c4c-4071-bc38-f9b076e2a591 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:51.929354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7110b-1c4c-4071-bc38-f9b076e2a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:51.941363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 527/1052] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:51 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:51.943632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:51.955711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-9cf7110b-1c4c-4071-bc38-f9b076e2a591 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:51.957114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-9cf7110b-1c4c-4071-bc38-f9b076e2a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:51.964347 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:52.036708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 526/1053] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:52.049194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dee2ce-88e5-4e68-8e7b-8f6d1591cf58 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:52.084769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:52.085402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:52.085679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:52.085949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:52.087078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] RBAC: Authorizing `identity:get_project(project_id=7afc5e54133c491a93b1d971e15d36e0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:52.088521 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:52.095404 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 528/1054] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:47:51 2022] GET /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:52.096916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7110b-1c4c-4071-bc38-f9b076e2a591 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:52.201731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7110b-1c4c-4071-bc38-f9b076e2a591 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:52.219994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:52.238412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:52.239027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:52.239332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:52.239603 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:52.240331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=7afc5e54133c491a93b1d971e15d36e0, user.id=eedd5c0f31a4466e959d5007886c8054) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:52.240648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:52.242134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:52.255587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 527/1055] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:52 2022] GET /identity/v3/role_assignments?user.id=eedd5c0f31a4466e959d5007886c8054&scope.project.id=7afc5e54133c491a93b1d971e15d36e0&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:52.315817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:52.414791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:52.427567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec970ae6-acd9-4f3f-9b82-ea45879bbf90 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:52.471369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:52.472149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:52.472491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:52.472772 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] PATH_INFO: `/v3/services/image` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:52.473368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:52.474743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:52.484029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:52.485120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:47:52.486019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:52.490313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 529/1056] 10.222.0.58 () {56 vars in 1105 bytes} [Sun Aug 28 00:47:52 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:52.492071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:52.598559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26b85-234d-4fe2-bafc-261fab4daacf None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:52.633454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:52.634069 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:52.634344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:52.634613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:52.635332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] RBAC: Adding query filter params (name=image) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:52.635636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:52.636995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:52.646784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 528/1057] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:52.650440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:52.758981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb255d7-7333-4611-9929-9dacc677ae92 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:52.796293 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f170d-766e-4d06-9bce-d28f926d8fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:52.796913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f170d-766e-4d06-9bce-d28f926d8fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:52.797191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f170d-766e-4d06-9bce-d28f926d8fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:52.797466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f170d-766e-4d06-9bce-d28f926d8fb4 None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:52.798110 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f170d-766e-4d06-9bce-d28f926d8fb4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:52.798416 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f170d-766e-4d06-9bce-d28f926d8fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:52.799839 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f170d-766e-4d06-9bce-d28f926d8fb4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:52.810978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 530/1058] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:52.811959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:52.862426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:52.920237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4bc62-174e-4fb2-b556-33f76fe94cde None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:52.956580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129279ce-c890-47b9-832b-fd64bc0f9c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:52.957281 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129279ce-c890-47b9-832b-fd64bc0f9c63 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:52.957555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129279ce-c890-47b9-832b-fd64bc0f9c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:52.957830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129279ce-c890-47b9-832b-fd64bc0f9c63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:52.958615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129279ce-c890-47b9-832b-fd64bc0f9c63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:52.960033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129279ce-c890-47b9-832b-fd64bc0f9c63 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:53.039240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 529/1059] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:47:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:53.186196 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1cde9-b461-4637-9822-32ca32ece74a None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:53.186490 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1cde9-b461-4637-9822-32ca32ece74a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:53.186678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1cde9-b461-4637-9822-32ca32ece74a None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:53.188064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 531/1060] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:53.193646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b557a-c949-4e6d-8c5d-ebd5aef77682 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:53.193928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b557a-c949-4e6d-8c5d-ebd5aef77682 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:53.194223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b557a-c949-4e6d-8c5d-ebd5aef77682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:53.214072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-be1b557a-c949-4e6d-8c5d-ebd5aef77682 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:53.215418 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-be1b557a-c949-4e6d-8c5d-ebd5aef77682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:53.298493 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 530/1061] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:53.568620 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1cde9-b461-4637-9822-32ca32ece74a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:53.588724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:53.680334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1cde9-b461-4637-9822-32ca32ece74a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:53.715755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:53.716396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:53.716672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:53.716942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:53.728863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:53.733647 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:53.734629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:53.735898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:53.739282 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 532/1062] 10.222.0.58 () {56 vars in 1120 bytes} [Sun Aug 28 00:47:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:53.741284 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b557a-c949-4e6d-8c5d-ebd5aef77682 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:53.770539 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:53.848015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b557a-c949-4e6d-8c5d-ebd5aef77682 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:53.884505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:53.885121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:53.885400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:53.885672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:53.886347 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:53.886647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:53.888053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:53.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 531/1063] 10.222.0.58 () {56 vars in 1115 bytes} [Sun Aug 28 00:47:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:53.903483 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:53.984051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.008258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba931ec-7baa-4ef3-8350-94d69bd50273 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.045634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5351b7-7cb0-4a11-a0d7-7ab332a699e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.046276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5351b7-7cb0-4a11-a0d7-7ab332a699e3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.046552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5351b7-7cb0-4a11-a0d7-7ab332a699e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.046822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5351b7-7cb0-4a11-a0d7-7ab332a699e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.058895 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5351b7-7cb0-4a11-a0d7-7ab332a699e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.060447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5351b7-7cb0-4a11-a0d7-7ab332a699e3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-3c5351b7-7cb0-4a11-a0d7-7ab332a699e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:54.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:54.077061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:54.085166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:54.085166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:54.085166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:54.085166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 533/1064] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:54.085477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.182006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.196117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0e66-9590-4de9-8715-70e8b279a033 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.219595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca045-bddc-4556-87ad-c8111b4ed014 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.219913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca045-bddc-4556-87ad-c8111b4ed014 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.220140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca045-bddc-4556-87ad-c8111b4ed014 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.221661 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 534/1065] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:54.227595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256cd9b-3708-4106-8be5-2069ebd7e24b None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.227887 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256cd9b-3708-4106-8be5-2069ebd7e24b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.228171 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256cd9b-3708-4106-8be5-2069ebd7e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.233675 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.234287 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.234563 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.234836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.235519 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:54.235821 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.237201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.247662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b256cd9b-3708-4106-8be5-2069ebd7e24b None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:54.249130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b256cd9b-3708-4106-8be5-2069ebd7e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:54.250129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 532/1066] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:54.255830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.330015 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 535/1067] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:47:54.367126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9cd92-98f2-4c64-95e8-c98b7262c9b3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.404361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.404993 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.405269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.405541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.413579 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.415035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:54.428613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:54.429793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:54.430810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:54.434701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 533/1068] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:54.435972 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256cd9b-3708-4106-8be5-2069ebd7e24b None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.501076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.544531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256cd9b-3708-4106-8be5-2069ebd7e24b None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.580970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.582157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.582614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.583087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.583938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:54.584253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.585709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.609646 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 536/1069] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:54.609863 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.611158 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.620363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.726297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a4bf8-69cb-4078-93dc-3186686b0943 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.734623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8928af-c8ab-49e5-9788-6255bef6e278 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.754662 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.762345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.763040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.763306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.763578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.774150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.774798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.775076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.775376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.776864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:54.782791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:47:54.783800 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 534/1070] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:54.789217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.789475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.790974 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:54.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:54.808780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:54.809694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:54.809694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:54.809694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:54.809694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 537/1071] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:54.814762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.862833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:54.899379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449bf12-a172-459c-8d0a-90775606a486 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.925295 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858377d-8a22-4d22-ad8b-05265ff7b487 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:54.937138 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.937751 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.938028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.938298 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.938960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:54.939288 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.941182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.954876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 535/1072] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:54.955954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:54.968919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:54.970036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:54.970469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:54.970747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:54.971431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:54.971735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:54.974062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:54.986642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 538/1073] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:54.993556 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.023377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.072180 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb073-0537-4545-8935-567bc259c3a6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.096141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d458d1-e3c2-4766-9cb8-216ebc5384f0 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.100695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.106354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3233a-32f5-49da-82a0-9537e8cdb2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.106987 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3233a-32f5-49da-82a0-9537e8cdb2eb None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.107304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3233a-32f5-49da-82a0-9537e8cdb2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.107581 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3233a-32f5-49da-82a0-9537e8cdb2eb None admin] PATH_INFO: `/v3/users/eedd5c0f31a4466e959d5007886c8054` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.108731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3233a-32f5-49da-82a0-9537e8cdb2eb None admin] RBAC: Authorizing `identity:get_user(user_id=eedd5c0f31a4466e959d5007886c8054)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.110161 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3233a-32f5-49da-82a0-9537e8cdb2eb None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.111796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 536/1074] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/users/eedd5c0f31a4466e959d5007886c8054 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:55.113482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a51d-4e29-4636-bb1d-949659259abd None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.113758 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a51d-4e29-4636-bb1d-949659259abd None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.114029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a51d-4e29-4636-bb1d-949659259abd None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.115280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 537/1075] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:55.118053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018a51d-4e29-4636-bb1d-949659259abd None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.133974 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90bba-d255-4402-98b6-577f9a0f34f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.134608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90bba-d255-4402-98b6-577f9a0f34f9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.134892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90bba-d255-4402-98b6-577f9a0f34f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.135209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90bba-d255-4402-98b6-577f9a0f34f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.141966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90bba-d255-4402-98b6-577f9a0f34f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.143479 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90bba-d255-4402-98b6-577f9a0f34f9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-afd90bba-d255-4402-98b6-577f9a0f34f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:55.156589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:55.157619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:55.158595 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 539/1076] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:55.160151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39581338-bfdc-4cc5-9614-cadcb9961eca None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.160151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39581338-bfdc-4cc5-9614-cadcb9961eca None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.160331 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39581338-bfdc-4cc5-9614-cadcb9961eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.178353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-39581338-bfdc-4cc5-9614-cadcb9961eca None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:55.179629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-39581338-bfdc-4cc5-9614-cadcb9961eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:55.225555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018a51d-4e29-4636-bb1d-949659259abd None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.249081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 540/1077] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:55.249765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39581338-bfdc-4cc5-9614-cadcb9961eca None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.262546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.263229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.263510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.263784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.264941 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] RBAC: Authorizing `identity:get_project(project_id=7afc5e54133c491a93b1d971e15d36e0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.266387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.273860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 538/1078] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:47:55 2022] GET /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:55.274621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.285036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.350197 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39581338-bfdc-4cc5-9614-cadcb9961eca None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.391590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7391ac-c779-4c84-9824-980ec3bd6a90 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.424328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.424952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.425224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.425495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.426205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:55.426509 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.427651 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.427968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.428307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.428581 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.428850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0/users/eedd5c0f31a4466e959d5007886c8054/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.430792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] RBAC: Authorizing `identity:create_grant(project_id=7afc5e54133c491a93b1d971e15d36e0, user_id=eedd5c0f31a4466e959d5007886c8054, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.432245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.441131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 541/1079] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:55.447247 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.495933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 539/1080] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:47:55 2022] PUT /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0/users/eedd5c0f31a4466e959d5007886c8054/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:47:55.525238 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.536279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.561350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d408-124a-41dd-a667-ac9feeb3354a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.602891 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.603608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.604117 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.604117 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/d1cdc7db1f714849ba14a987d2412591/roles/98690d641a3c4641a7aef40137e16cfc` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.606471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=d1cdc7db1f714849ba14a987d2412591, role_id=98690d641a3c4641a7aef40137e16cfc)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.608027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.647317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff710dd-5276-4ce1-acd4-26878a506f94 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:55.677481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:55.686136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:55.686734 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:55.687081 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:55.687348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:55.695901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 542/1081] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:47:55 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/d1cdc7db1f714849ba14a987d2412591/roles/98690d641a3c4641a7aef40137e16cfc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:47:55.765701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:55.767203 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:55.883387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 540/1082] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:47:55.889525 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:55.996841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473a956-d805-4559-8e96-4f42290b3239 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:56.040356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faaf10-dc5f-4742-aa71-0a5b1272ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:56.040989 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faaf10-dc5f-4742-aa71-0a5b1272ce00 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.041264 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faaf10-dc5f-4742-aa71-0a5b1272ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.041534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faaf10-dc5f-4742-aa71-0a5b1272ce00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.049101 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:56.053654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faaf10-dc5f-4742-aa71-0a5b1272ce00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:56.055131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faaf10-dc5f-4742-aa71-0a5b1272ce00 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-29faaf10-dc5f-4742-aa71-0a5b1272ce00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:56.069568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:56.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:56.071545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:56.071545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:56.071545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:56.071545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 543/1083] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:56.079154 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:56.106682 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:56.193942 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b4177-ee95-4fc9-851c-6f5e85c05926 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:56.230546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b043dfd-97de-4999-9aca-044af7141092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:56.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043dfd-97de-4999-9aca-044af7141092 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:56.231454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043dfd-97de-4999-9aca-044af7141092 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:56.231724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043dfd-97de-4999-9aca-044af7141092 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:56.232360 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043dfd-97de-4999-9aca-044af7141092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:56.232663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043dfd-97de-4999-9aca-044af7141092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:56.234026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043dfd-97de-4999-9aca-044af7141092 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:56.251143 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 541/1084] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:57.426997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49948b-bba3-468e-a050-26b992a8140b None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:57.427587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49948b-bba3-468e-a050-26b992a8140b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:57.427587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49948b-bba3-468e-a050-26b992a8140b None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:57.428908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 544/1085] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:47:57.434109 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de666a-cc19-4f2c-bba3-d4feee7c64c3 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:57.434544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de666a-cc19-4f2c-bba3-d4feee7c64c3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:57.434659 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de666a-cc19-4f2c-bba3-d4feee7c64c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:57.452920 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-46de666a-cc19-4f2c-bba3-d4feee7c64c3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:57.454110 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-46de666a-cc19-4f2c-bba3-d4feee7c64c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:57.525444 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 542/1086] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:57.623453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3cef5-379b-4e3d-a968-c019e46e549f None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:57.623732 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3cef5-379b-4e3d-a968-c019e46e549f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:57.624005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3cef5-379b-4e3d-a968-c019e46e549f None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:57.625338 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 545/1087] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:57.631446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b5c62-5fa8-4014-b055-a07563da8bb1 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:57.631734 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b5c62-5fa8-4014-b055-a07563da8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:57.632007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b5c62-5fa8-4014-b055-a07563da8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:57.650809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-422b5c62-5fa8-4014-b055-a07563da8bb1 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:57.652056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-422b5c62-5fa8-4014-b055-a07563da8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:57.663913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:57.722614 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 543/1088] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:57.793389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3cef5-379b-4e3d-a968-c019e46e549f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:57.896637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3cef5-379b-4e3d-a968-c019e46e549f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:57.930957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:57.931607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:57.931880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:57.932147 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:57.943223 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:57.947918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:57.948920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:57.950173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 546/1089] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:57.954926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b5c62-5fa8-4014-b055-a07563da8bb1 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:57.992569 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.043673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.055552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b5c62-5fa8-4014-b055-a07563da8bb1 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.090981 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.091615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.091890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.092159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.092817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:58.093110 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.094470 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.095307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fd5d0-fde9-4aa7-ad53-6d3cac307d08 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.102751 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 544/1090] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:58.108536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.119923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.129955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.132643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.132643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.132643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.141660 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:58.146493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:58.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:58.148577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 547/1091] 10.222.0.58 () {56 vars in 1120 bytes} [Sun Aug 28 00:47:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:58.153487 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.209738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaaf6e-502a-407a-9f44-626b37be4358 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.245901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.246441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.246712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.246982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] PATH_INFO: `/v3/users/eedd5c0f31a4466e959d5007886c8054` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.248132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=eedd5c0f31a4466e959d5007886c8054)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.249551 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.251145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 545/1092] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/users/eedd5c0f31a4466e959d5007886c8054 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:58.251817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865c0ad-f78f-4df9-84da-9c3276f4a521 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.257768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.263250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.286784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.287476 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.287752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.288025 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.288686 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:58.288985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.290344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.299434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 548/1093] 10.222.0.58 () {56 vars in 1115 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:58.305851 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.342047 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.365240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1694-99f9-4538-a494-a0b5ba1b7dc6 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.400739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.401349 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.401631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.401907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.405248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158436-2397-445b-8f85-0d8fb83fb7a2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.438365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.439033 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.439270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.439536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.450005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.451469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:58.466918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:58.467970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:58.468888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:58.468888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:58.468888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:58.468888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 549/1094] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:58.472873 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.474065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.474328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.499090 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.553187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.576171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 546/1095] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:47:58.576873 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354a676-5c91-434e-b99a-0d8ba119d643 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.582653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.614252 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.614886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.615196 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.615470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.616113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:58.616412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.617790 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.630005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 550/1096] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:58.639071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.684644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5a16e-015d-444b-8831-0d636c1edc6d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.720620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.721244 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.721517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.721863 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.722958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] RBAC: Authorizing `identity:get_project(project_id=7afc5e54133c491a93b1d971e15d36e0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.724416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.726033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 547/1097] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:58.732048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.740359 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.756450 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f2c0c-c0f6-4c5a-aef8-eb84bf045c0b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.779718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:58.789421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.790057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.790330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.790602 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.798123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.799590 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:47:58.811596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:58.814679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:58.816440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 551/1098] 10.222.0.58 () {56 vars in 1093 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:47:58.819386 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:58.841459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7745011-0508-4d1b-bde6-a0c2f2fff8cb None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.875446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.876056 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.876334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.876605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.877333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=7afc5e54133c491a93b1d971e15d36e0, user.id=eedd5c0f31a4466e959d5007886c8054) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:58.877633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.879361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.885010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 548/1099] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/role_assignments?user.id=eedd5c0f31a4466e959d5007886c8054&scope.project.id=7afc5e54133c491a93b1d971e15d36e0&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:58.921922 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbedbd-e5bf-45bd-9c84-34bc776f579d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:58.959575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:58.960186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:58.960461 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:58.960727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:58.961466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:58.961764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:58.963235 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:58.983092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 552/1100] 10.222.0.58 () {56 vars in 1133 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:58.989228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:59.102147 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdbdaa-f65c-47af-9c7a-005fca8062b0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:59.111114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:59.136112 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:59.136715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:59.137009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:59.137251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:59.203377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:59.204836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:59.308346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 549/1101] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:59.314142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:59.317182 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:59.424782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb2ea-5d01-4c7c-8646-0f27c7e5a621 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:59.460321 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:59.460983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:59.461207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:59.461471 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:59.472615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:59.474065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:47:59.489750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:59.490981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:47:59.491959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:47:59.491959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:47:59.491959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:59.491959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 553/1102] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:59.496814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:59.509335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:59.607812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8f1d-aa1d-4e3d-bf07-331c282a0e46 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:59.646422 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:59.647037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:59.647341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:59.647625 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:59.648267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:59.649178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:59.649950 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:59.664812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 550/1103] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:59.670603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:59.731830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:59.784562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ff88-80e9-4be7-b615-1f060f94caa7 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:59.821421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:59.821886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:59.822189 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:59.822424 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:59.829559 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:59.831019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:47:59.843507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:59.844465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:47:59.845382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 554/1104] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:59.851195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:59.923997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:59.959286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b1437-a198-469a-bc83-c7af04b29651 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:59.994011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94448ae5-2d3a-4f8e-9cbf-817a0561ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:59.994541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94448ae5-2d3a-4f8e-9cbf-817a0561ab66 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:59.994815 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94448ae5-2d3a-4f8e-9cbf-817a0561ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:59.995090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94448ae5-2d3a-4f8e-9cbf-817a0561ab66 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:59.995805 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94448ae5-2d3a-4f8e-9cbf-817a0561ab66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:59.996098 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94448ae5-2d3a-4f8e-9cbf-817a0561ab66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:59.997524 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94448ae5-2d3a-4f8e-9cbf-817a0561ab66 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:00.011676 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 551/1105] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:00.019651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:00.132625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563720c-2244-4706-a157-285d45dc1a25 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:00.147070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:00.170154 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afed88-ecfb-4265-8901-fb1aaf466aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:00.170766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afed88-ecfb-4265-8901-fb1aaf466aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:00.171044 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afed88-ecfb-4265-8901-fb1aaf466aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:00.171367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afed88-ecfb-4265-8901-fb1aaf466aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:00.172070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afed88-ecfb-4265-8901-fb1aaf466aa9 None admin] RBAC: Adding query filter params (role.id=98690d641a3c4641a7aef40137e16cfc, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=d1cdc7db1f714849ba14a987d2412591) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:00.172388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afed88-ecfb-4265-8901-fb1aaf466aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:00.173821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afed88-ecfb-4265-8901-fb1aaf466aa9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:00.180673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 555/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:00 2022] GET /identity/v3/role_assignments?user.id=d1cdc7db1f714849ba14a987d2412591&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=98690d641a3c4641a7aef40137e16cfc => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:00.864235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66261e2e-ed30-4035-ba06-9db800b349ed None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:00.864971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66261e2e-ed30-4035-ba06-9db800b349ed None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:00.864971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66261e2e-ed30-4035-ba06-9db800b349ed None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:00.866128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 552/1107] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:00.872285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71e0b-41e9-4846-b607-2a54b7cecaa2 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:00.872739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71e0b-41e9-4846-b607-2a54b7cecaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:00.872825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71e0b-41e9-4846-b607-2a54b7cecaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:00.892021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-71f71e0b-41e9-4846-b607-2a54b7cecaa2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:00.893226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-71f71e0b-41e9-4846-b607-2a54b7cecaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:00.974349 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 556/1108] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:01.245384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66261e2e-ed30-4035-ba06-9db800b349ed None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:01.348281 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66261e2e-ed30-4035-ba06-9db800b349ed None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:01.374265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:01.383038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348d121-2555-4bb8-91ff-3b056472bd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:01.389361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348d121-2555-4bb8-91ff-3b056472bd9f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:01.389361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348d121-2555-4bb8-91ff-3b056472bd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:01.389361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348d121-2555-4bb8-91ff-3b056472bd9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:01.389361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348d121-2555-4bb8-91ff-3b056472bd9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:01.389361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348d121-2555-4bb8-91ff-3b056472bd9f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:01.389361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 553/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:01.395310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f71e0b-41e9-4846-b607-2a54b7cecaa2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:01.501899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f71e0b-41e9-4846-b607-2a54b7cecaa2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:01.511680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:01.540213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb088d-9ae3-4af1-b0c8-69befbace43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:01.540815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb088d-9ae3-4af1-b0c8-69befbace43a None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:01.541091 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb088d-9ae3-4af1-b0c8-69befbace43a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:01.541359 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb088d-9ae3-4af1-b0c8-69befbace43a None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:01.542008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb088d-9ae3-4af1-b0c8-69befbace43a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:01.543484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb088d-9ae3-4af1-b0c8-69befbace43a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:01.643031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 557/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:48:01 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:48:03.620037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30174-2358-4f1f-b75d-8a9001283235 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:03.620565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30174-2358-4f1f-b75d-8a9001283235 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:03.620565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30174-2358-4f1f-b75d-8a9001283235 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:03.621902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 554/1111] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:48:03.627333 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd289-b13a-41fe-bdf6-df2fe37ee26f None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:03.627752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd289-b13a-41fe-bdf6-df2fe37ee26f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:03.628004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd289-b13a-41fe-bdf6-df2fe37ee26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:03.646100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a15cd289-b13a-41fe-bdf6-df2fe37ee26f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:03.647366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a15cd289-b13a-41fe-bdf6-df2fe37ee26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:03.715472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 558/1112] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:48:03.985583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb30174-2358-4f1f-b75d-8a9001283235 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:04.091778 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb30174-2358-4f1f-b75d-8a9001283235 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:04.126483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:04.127129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:04.127416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:04.127720 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] PATH_INFO: `/v3/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:04.129795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] RBAC: Authorizing `identity:get_role(role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:04.131195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:04.132683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 555/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:03 2022] GET /identity/v3/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:04.138420 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd289-b13a-41fe-bdf6-df2fe37ee26f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:04.236725 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:04.243957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd289-b13a-41fe-bdf6-df2fe37ee26f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:04.299081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:04.299934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:04.300258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:04.300535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] PATH_INFO: `/v3/users/bda14c98038b427fbabad8eb6b2d2e8e` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:04.350035 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] RBAC: Authorizing `identity:get_user(user_id=bda14c98038b427fbabad8eb6b2d2e8e)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:04.351512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:04.353205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 559/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:04 2022] GET /identity/v3/users/bda14c98038b427fbabad8eb6b2d2e8e => generated 286 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:04.360899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:04.426902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:04.465899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae4ff-b719-4ec5-bccd-33b9d7100ad7 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:04.500157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:04.500676 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:04.500949 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:04.501216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:04.570065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:04.571572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:04.632193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:04.671013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 556/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:04.677255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:04.784317 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e2dcd-9f0b-4b53-8ade-3b1f1b413cee None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:04.824026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be77036-90cf-4b83-b4e7-34f2f6750e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:04.824657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be77036-90cf-4b83-b4e7-34f2f6750e54 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:04.824938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be77036-90cf-4b83-b4e7-34f2f6750e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:04.825213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be77036-90cf-4b83-b4e7-34f2f6750e54 None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:04.826342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be77036-90cf-4b83-b4e7-34f2f6750e54 None admin] RBAC: Authorizing `identity:get_project(project_id=7afc5e54133c491a93b1d971e15d36e0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:04.827800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be77036-90cf-4b83-b4e7-34f2f6750e54 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:04.829441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 560/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:04 2022] GET /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:04.835952 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:04.939328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55073-0b97-4818-9799-4abede18d0ec None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:04.974656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb36a0-d5f0-4009-9f78-ffe1ff57adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:04.975292 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb36a0-d5f0-4009-9f78-ffe1ff57adc5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:04.975573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb36a0-d5f0-4009-9f78-ffe1ff57adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:04.975845 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb36a0-d5f0-4009-9f78-ffe1ff57adc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:04.976567 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb36a0-d5f0-4009-9f78-ffe1ff57adc5 None admin] RBAC: Adding query filter params (role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=7afc5e54133c491a93b1d971e15d36e0, user.id=bda14c98038b427fbabad8eb6b2d2e8e) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:04.976876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb36a0-d5f0-4009-9f78-ffe1ff57adc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:04.978312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb36a0-d5f0-4009-9f78-ffe1ff57adc5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:04.983776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 557/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:04 2022] GET /identity/v3/role_assignments?user.id=bda14c98038b427fbabad8eb6b2d2e8e&scope.project.id=7afc5e54133c491a93b1d971e15d36e0&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:06.957651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a5a4-7fd5-4a4f-90f3-d1e397b3cab6 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:06.958154 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a5a4-7fd5-4a4f-90f3-d1e397b3cab6 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:06.958558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a5a4-7fd5-4a4f-90f3-d1e397b3cab6 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:06.961041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 561/1118] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:06.967011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f0a6-193d-458d-bb4e-c0de00adccd0 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:06.967471 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f0a6-193d-458d-bb4e-c0de00adccd0 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:06.967573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f0a6-193d-458d-bb4e-c0de00adccd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:06.995751 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-4347f0a6-193d-458d-bb4e-c0de00adccd0 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:06.996957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4347f0a6-193d-458d-bb4e-c0de00adccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:07.022415 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:07.070230 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 558/1119] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:07.360596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0a5a4-7fd5-4a4f-90f3-d1e397b3cab6 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:07.383962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:07.468910 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0a5a4-7fd5-4a4f-90f3-d1e397b3cab6 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:07.502911 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:07.503644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:07.503919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:07.504187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] PATH_INFO: `/v3/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:07.505562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] RBAC: Authorizing `identity:get_role(role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:07.506913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:07.508256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 562/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:07 2022] GET /identity/v3/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:07.514183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347f0a6-193d-458d-bb4e-c0de00adccd0 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:07.617247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347f0a6-193d-458d-bb4e-c0de00adccd0 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:07.652453 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:07.653093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:07.653369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:07.653642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] PATH_INFO: `/v3/users/bda14c98038b427fbabad8eb6b2d2e8e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:07.654766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] RBAC: Authorizing `identity:get_user(user_id=bda14c98038b427fbabad8eb6b2d2e8e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:07.656305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:07.657899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 559/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:07 2022] GET /identity/v3/users/bda14c98038b427fbabad8eb6b2d2e8e => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:07.664197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:07.754184 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:07.766254 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c242-d693-407e-934c-b29e4d1c4616 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:07.800983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7400a-ca92-401a-8665-178f63febfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:07.801601 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7400a-ca92-401a-8665-178f63febfde None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:07.801873 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7400a-ca92-401a-8665-178f63febfde None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:07.802144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7400a-ca92-401a-8665-178f63febfde None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:07.803279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7400a-ca92-401a-8665-178f63febfde None admin] RBAC: Authorizing `identity:get_project(project_id=7afc5e54133c491a93b1d971e15d36e0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:07.804699 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7400a-ca92-401a-8665-178f63febfde None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:07.806319 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 563/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:07 2022] GET /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:07.812345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:07.842049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:07.917756 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7cf24-aae5-4b1d-bb29-bdf2c82069f4 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:07.951955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc251-aabe-4988-9d44-7108e903a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:07.952627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc251-aabe-4988-9d44-7108e903a3fd None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:07.952907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc251-aabe-4988-9d44-7108e903a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:07.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc251-aabe-4988-9d44-7108e903a3fd None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0/users/bda14c98038b427fbabad8eb6b2d2e8e/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:07.956146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc251-aabe-4988-9d44-7108e903a3fd None admin] RBAC: Authorizing `identity:create_grant(project_id=7afc5e54133c491a93b1d971e15d36e0, user_id=bda14c98038b427fbabad8eb6b2d2e8e, role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:07.957604 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc251-aabe-4988-9d44-7108e903a3fd None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:08.059828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 560/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:48:07 2022] PUT /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0/users/bda14c98038b427fbabad8eb6b2d2e8e/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:48:09.967206 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580742af-27eb-4855-802f-f3a8d77672e5 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:09.967734 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580742af-27eb-4855-802f-f3a8d77672e5 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:09.967734 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580742af-27eb-4855-802f-f3a8d77672e5 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:09.968984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 564/1124] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:09.974827 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273087a3-ab91-4d68-9fde-fa4b4cfe9eb2 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:09.975291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273087a3-ab91-4d68-9fde-fa4b4cfe9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:09.975403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273087a3-ab91-4d68-9fde-fa4b4cfe9eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:09.993724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-273087a3-ab91-4d68-9fde-fa4b4cfe9eb2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:09.994901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-273087a3-ab91-4d68-9fde-fa4b4cfe9eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:10.062292 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 561/1125] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:10.343722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580742af-27eb-4855-802f-f3a8d77672e5 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:10.442817 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580742af-27eb-4855-802f-f3a8d77672e5 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:10.476114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:10.476726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:10.477001 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:10.477271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] PATH_INFO: `/v3/roles/8faf82d5605241e8a3b488b912cdfb81` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:10.478644 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] RBAC: Authorizing `identity:get_role(role_id=8faf82d5605241e8a3b488b912cdfb81)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:10.480020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:10.481315 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 565/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:10 2022] GET /identity/v3/roles/8faf82d5605241e8a3b488b912cdfb81 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:10.487287 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273087a3-ab91-4d68-9fde-fa4b4cfe9eb2 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:10.504717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:10.587817 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273087a3-ab91-4d68-9fde-fa4b4cfe9eb2 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:10.621370 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:10.622080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:10.622459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:10.622459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] PATH_INFO: `/v3/users/bda14c98038b427fbabad8eb6b2d2e8e` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:10.623675 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] RBAC: Authorizing `identity:get_user(user_id=bda14c98038b427fbabad8eb6b2d2e8e)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:10.625139 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:10.626711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 562/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:10 2022] GET /identity/v3/users/bda14c98038b427fbabad8eb6b2d2e8e => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:10.633250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:10.658606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:10.732743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bfa5b-0660-4974-9f90-e12a0d38b388 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:10.765818 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:10.766412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:10.766680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:10.766946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:10.831085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:10.832534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:10.856273 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:10.929506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 566/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:10.935532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:11.018718 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:11.034508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40775e3-3d99-47fb-86ba-63b842661622 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:11.066937 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ac63c-244d-4fcf-935b-e0657f6db8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:11.067572 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac63c-244d-4fcf-935b-e0657f6db8ef None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:11.067848 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac63c-244d-4fcf-935b-e0657f6db8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:11.068118 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac63c-244d-4fcf-935b-e0657f6db8ef None admin] PATH_INFO: `/v3/projects/7afc5e54133c491a93b1d971e15d36e0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:11.069216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ac63c-244d-4fcf-935b-e0657f6db8ef None admin] RBAC: Authorizing `identity:get_project(project_id=7afc5e54133c491a93b1d971e15d36e0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:11.070638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ac63c-244d-4fcf-935b-e0657f6db8ef None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:11.072268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 563/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:10 2022] GET /identity/v3/projects/7afc5e54133c491a93b1d971e15d36e0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:11.078540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:11.175932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845b35b-ee97-4bc2-9f7f-6acbbd4a05a3 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:11.199238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:11.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469d9aa-bbba-47f4-a883-85a63bc7de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:11.213845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469d9aa-bbba-47f4-a883-85a63bc7de3d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:11.213845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469d9aa-bbba-47f4-a883-85a63bc7de3d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:11.213845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469d9aa-bbba-47f4-a883-85a63bc7de3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:11.213845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469d9aa-bbba-47f4-a883-85a63bc7de3d None admin] RBAC: Adding query filter params (role.id=8faf82d5605241e8a3b488b912cdfb81, scope.project.id=7afc5e54133c491a93b1d971e15d36e0, user.id=bda14c98038b427fbabad8eb6b2d2e8e) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:11.213845 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469d9aa-bbba-47f4-a883-85a63bc7de3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:11.214513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469d9aa-bbba-47f4-a883-85a63bc7de3d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:11.220582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 567/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:11 2022] GET /identity/v3/role_assignments?user.id=bda14c98038b427fbabad8eb6b2d2e8e&scope.project.id=7afc5e54133c491a93b1d971e15d36e0&role.id=8faf82d5605241e8a3b488b912cdfb81 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:13.166277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351f01-651b-4ec3-80d6-2b9e1a234885 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:13.166847 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351f01-651b-4ec3-80d6-2b9e1a234885 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:13.166847 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351f01-651b-4ec3-80d6-2b9e1a234885 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:13.168196 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 564/1131] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:13.173633 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c062d-1180-4eba-8f82-d21d0be72fed None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:13.174637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c062d-1180-4eba-8f82-d21d0be72fed None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:13.174739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c062d-1180-4eba-8f82-d21d0be72fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:13.193405 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-5a8c062d-1180-4eba-8f82-d21d0be72fed None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:13.194591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-5a8c062d-1180-4eba-8f82-d21d0be72fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:13.262907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 568/1132] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:13.531391 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351f01-651b-4ec3-80d6-2b9e1a234885 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:13.632666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351f01-651b-4ec3-80d6-2b9e1a234885 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:13.666910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec564da-332c-4768-aebb-9c7daee407cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:13.667581 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec564da-332c-4768-aebb-9c7daee407cf None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:13.667856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec564da-332c-4768-aebb-9c7daee407cf None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:13.668128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec564da-332c-4768-aebb-9c7daee407cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:13.669574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec564da-332c-4768-aebb-9c7daee407cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:13.670694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec564da-332c-4768-aebb-9c7daee407cf None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:13.672442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 565/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:13.679137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c062d-1180-4eba-8f82-d21d0be72fed None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:13.777283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c062d-1180-4eba-8f82-d21d0be72fed None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:13.794577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:13.810908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc426606-3694-4568-a176-e929acc42d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:13.811544 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426606-3694-4568-a176-e929acc42d81 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:13.814063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426606-3694-4568-a176-e929acc42d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:13.814063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426606-3694-4568-a176-e929acc42d81 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:13.814063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc426606-3694-4568-a176-e929acc42d81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:13.814328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc426606-3694-4568-a176-e929acc42d81 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:13.888632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 569/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:48:13 2022] POST /identity/v3/projects => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:48:15.826055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b784-1f59-49ca-a31b-d2f8a1946097 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:15.826595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b784-1f59-49ca-a31b-d2f8a1946097 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:15.826595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b784-1f59-49ca-a31b-d2f8a1946097 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:15.827955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 566/1135] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:15.833355 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae9146-7459-4974-8a85-6f0becaf86af None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:15.833781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae9146-7459-4974-8a85-6f0becaf86af None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:15.833901 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae9146-7459-4974-8a85-6f0becaf86af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:15.852552 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-49ae9146-7459-4974-8a85-6f0becaf86af None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:15.853751 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-49ae9146-7459-4974-8a85-6f0becaf86af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:15.919923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 570/1136] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:16.194312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b784-1f59-49ca-a31b-d2f8a1946097 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:16.217053 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:16.297962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b784-1f59-49ca-a31b-d2f8a1946097 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:16.331874 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a079d-61f9-417c-8360-b3ccac1badef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:16.332496 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a079d-61f9-417c-8360-b3ccac1badef None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:16.332768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a079d-61f9-417c-8360-b3ccac1badef None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:16.333032 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a079d-61f9-417c-8360-b3ccac1badef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:16.334135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a079d-61f9-417c-8360-b3ccac1badef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:16.335598 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a079d-61f9-417c-8360-b3ccac1badef None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:16.337152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 567/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:16.343238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae9146-7459-4974-8a85-6f0becaf86af None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:16.441909 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:16.444886 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae9146-7459-4974-8a85-6f0becaf86af None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:16.479080 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e1ac7-bb85-4e6a-9be1-7975f8aa72d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:16.479716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1ac7-bb85-4e6a-9be1-7975f8aa72d5 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:16.479996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1ac7-bb85-4e6a-9be1-7975f8aa72d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:16.480294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1ac7-bb85-4e6a-9be1-7975f8aa72d5 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:16.480957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e1ac7-bb85-4e6a-9be1-7975f8aa72d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:16.482387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e1ac7-bb85-4e6a-9be1-7975f8aa72d5 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:16.579086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 571/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:48:16 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:48:18.545023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bdf4-af02-4399-aeaf-917e808f84f6 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:18.545574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bdf4-af02-4399-aeaf-917e808f84f6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:18.545574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bdf4-af02-4399-aeaf-917e808f84f6 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:18.546887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 568/1139] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:18.552409 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83db87c-e9da-483d-865b-1cdfed72787a None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:18.552838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83db87c-e9da-483d-865b-1cdfed72787a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:18.552955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83db87c-e9da-483d-865b-1cdfed72787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:18.572200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b83db87c-e9da-483d-865b-1cdfed72787a None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:18.573410 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b83db87c-e9da-483d-865b-1cdfed72787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:18.642184 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 572/1140] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:48:18.910029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bdf4-af02-4399-aeaf-917e808f84f6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:18.997697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.010809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bdf4-af02-4399-aeaf-917e808f84f6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.048181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.049362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.049699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.049969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.060532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:19.065992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:19.067434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:48:19.068654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 569/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:19.073384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83db87c-e9da-483d-865b-1cdfed72787a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.156386 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.174159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83db87c-e9da-483d-865b-1cdfed72787a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.209549 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.210155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.210429 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.210699 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.211432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:19.211948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.213911 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.222501 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 573/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:19.228326 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.329145 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064dd5d-2458-4e22-9083-9638bc908f02 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.364602 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.365228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.365507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.365782 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] PATH_INFO: `/v3/users/92822546e550407093c49b31ab90554f` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.379571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] RBAC: Authorizing `identity:get_user(user_id=92822546e550407093c49b31ab90554f)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.381028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.382672 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 570/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/users/92822546e550407093c49b31ab90554f => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:19.388638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.488506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec428-1c04-4247-a4dd-069ff89752d7 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.522174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.522784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.523062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.523364 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.540804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.590869 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.592353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.688834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 574/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:19.695325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.704216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.795933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6ec59-8168-407f-b968-c1baef30b3d3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.829131 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926ef06-94e4-471b-aca3-49f891d4456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.830321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ef06-94e4-471b-aca3-49f891d4456d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.830544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ef06-94e4-471b-aca3-49f891d4456d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.830812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ef06-94e4-471b-aca3-49f891d4456d None admin] PATH_INFO: `/v3/projects/f055d496950c4414934e2d6ab6d1e9b6` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.831964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926ef06-94e4-471b-aca3-49f891d4456d None admin] RBAC: Authorizing `identity:get_project(project_id=f055d496950c4414934e2d6ab6d1e9b6)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.833391 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926ef06-94e4-471b-aca3-49f891d4456d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.835023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 571/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/projects/f055d496950c4414934e2d6ab6d1e9b6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:19.841588 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.890488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.941408 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28a129-a6e1-4c26-9081-e34fc2b2a8c2 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.975656 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea758774-586e-4deb-8f1e-ff4b98c928a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.976255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758774-586e-4deb-8f1e-ff4b98c928a4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.976530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758774-586e-4deb-8f1e-ff4b98c928a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.976801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758774-586e-4deb-8f1e-ff4b98c928a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.977523 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea758774-586e-4deb-8f1e-ff4b98c928a4 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=f055d496950c4414934e2d6ab6d1e9b6, user.id=92822546e550407093c49b31ab90554f) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:19.977827 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea758774-586e-4deb-8f1e-ff4b98c928a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.979270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea758774-586e-4deb-8f1e-ff4b98c928a4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.984836 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 575/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/role_assignments?user.id=92822546e550407093c49b31ab90554f&scope.project.id=f055d496950c4414934e2d6ab6d1e9b6&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:21.914363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe748e7-d168-45a6-b134-444476ffad92 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:21.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe748e7-d168-45a6-b134-444476ffad92 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:21.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe748e7-d168-45a6-b134-444476ffad92 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:21.916286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 572/1147] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:21.921515 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbd94-56b1-462d-91e1-3e6aead874e0 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:21.921894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbd94-56b1-462d-91e1-3e6aead874e0 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:21.922009 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbd94-56b1-462d-91e1-3e6aead874e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:21.940482 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-184dbd94-56b1-462d-91e1-3e6aead874e0 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:21.941668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-184dbd94-56b1-462d-91e1-3e6aead874e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:22.008352 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 576/1148] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:22.276959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe748e7-d168-45a6-b134-444476ffad92 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:22.354985 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:22.382611 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe748e7-d168-45a6-b134-444476ffad92 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:22.417735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:22.418366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:22.418645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:22.418914 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:22.429710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:22.434518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:22.435695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:48:22.436832 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 573/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:22.442495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbd94-56b1-462d-91e1-3e6aead874e0 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:22.487078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:22.544021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbd94-56b1-462d-91e1-3e6aead874e0 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:22.578907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:22.579584 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:22.579907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:22.580396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:22.581140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:22.581447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:22.582811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:22.591128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 577/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:22.597690 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:22.699524 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86297035-8dda-4580-8297-9133d83e4988 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:22.734095 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:22.734708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:22.734980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:22.735275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] PATH_INFO: `/v3/users/92822546e550407093c49b31ab90554f` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:22.736991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] RBAC: Authorizing `identity:get_user(user_id=92822546e550407093c49b31ab90554f)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:22.738413 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:22.740002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 574/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:22 2022] GET /identity/v3/users/92822546e550407093c49b31ab90554f => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:22.745791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:22.844413 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba76cb-f397-432c-9595-2272644b9b13 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:22.846747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:22.878073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4e5f6-3dff-400b-9fc9-07144a62570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:22.878686 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e5f6-3dff-400b-9fc9-07144a62570e None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:22.878959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e5f6-3dff-400b-9fc9-07144a62570e None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:22.879269 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e5f6-3dff-400b-9fc9-07144a62570e None admin] PATH_INFO: `/v3/projects/f055d496950c4414934e2d6ab6d1e9b6` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:22.880375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4e5f6-3dff-400b-9fc9-07144a62570e None admin] RBAC: Authorizing `identity:get_project(project_id=f055d496950c4414934e2d6ab6d1e9b6)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:22.882134 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4e5f6-3dff-400b-9fc9-07144a62570e None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:22.884056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 578/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:22 2022] GET /identity/v3/projects/f055d496950c4414934e2d6ab6d1e9b6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:22.889716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:22.893146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:22.987458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc54b-6ad5-4c1e-ae9e-c56e5ab2e179 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:23.019880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67d06f-3a99-490d-b17c-83a43860439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:23.020520 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d06f-3a99-490d-b17c-83a43860439a None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:23.020795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d06f-3a99-490d-b17c-83a43860439a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:23.021065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d06f-3a99-490d-b17c-83a43860439a None admin] PATH_INFO: `/v3/projects/f055d496950c4414934e2d6ab6d1e9b6/users/92822546e550407093c49b31ab90554f/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:23.022918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67d06f-3a99-490d-b17c-83a43860439a None admin] RBAC: Authorizing `identity:create_grant(project_id=f055d496950c4414934e2d6ab6d1e9b6, user_id=92822546e550407093c49b31ab90554f, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:23.024358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67d06f-3a99-490d-b17c-83a43860439a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:23.103945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 575/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:48:22 2022] PUT /identity/v3/projects/f055d496950c4414934e2d6ab6d1e9b6/users/92822546e550407093c49b31ab90554f/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:48:24.993306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8304-73be-4575-9e74-4cdd4217c87d None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:24.993806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8304-73be-4575-9e74-4cdd4217c87d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:24.993806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8304-73be-4575-9e74-4cdd4217c87d None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:24.995083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 579/1154] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:25.000226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbe62-9edf-497d-a12d-ec023cb52fe4 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.000629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbe62-9edf-497d-a12d-ec023cb52fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.000763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbe62-9edf-497d-a12d-ec023cb52fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.019129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-72dcbe62-9edf-497d-a12d-ec023cb52fe4 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:25.020340 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-72dcbe62-9edf-497d-a12d-ec023cb52fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:25.074481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:25.084814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 576/1155] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:25.355365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8304-73be-4575-9e74-4cdd4217c87d None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.453499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8304-73be-4575-9e74-4cdd4217c87d None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.486080 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.486682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.486955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.487253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.497308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:25.502635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:25.503778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:48:25.504671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 580/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:25.509743 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcbe62-9edf-497d-a12d-ec023cb52fe4 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.606750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcbe62-9edf-497d-a12d-ec023cb52fe4 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.639655 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.640251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.640526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.640795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.641453 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:25.641752 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.643768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.651900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 577/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:25.657672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.689415 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:25.757281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42613a9-715a-4d04-94ec-e5bf13128660 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.789345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.789956 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.790229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.790499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] PATH_INFO: `/v3/users/92822546e550407093c49b31ab90554f` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.791627 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] RBAC: Authorizing `identity:get_user(user_id=92822546e550407093c49b31ab90554f)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.793043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.794606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 581/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/users/92822546e550407093c49b31ab90554f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:25.801528 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.856849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:25.902058 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588b1c-47db-46aa-915e-c42948a6608c None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.935178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.935788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.936069 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.936341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.002866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:26.004345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:26.056028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:26.102746 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 578/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:26.108903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:26.204136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:26.207010 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a246baf-b5ff-4a53-9949-c9999c5d41f9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:26.241563 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e76a7-8c34-498b-a2df-dc03e7c89949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:26.242186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e76a7-8c34-498b-a2df-dc03e7c89949 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.242462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e76a7-8c34-498b-a2df-dc03e7c89949 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.242736 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e76a7-8c34-498b-a2df-dc03e7c89949 None admin] PATH_INFO: `/v3/projects/f055d496950c4414934e2d6ab6d1e9b6` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.243887 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e76a7-8c34-498b-a2df-dc03e7c89949 None admin] RBAC: Authorizing `identity:get_project(project_id=f055d496950c4414934e2d6ab6d1e9b6)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:26.245320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e76a7-8c34-498b-a2df-dc03e7c89949 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:26.246950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 582/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:26 2022] GET /identity/v3/projects/f055d496950c4414934e2d6ab6d1e9b6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:26.253937 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:26.351294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002d45c-8b01-475b-ba9d-fca44c935bf3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:26.384689 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca700-790f-4cac-99d3-3c92a454da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:26.385233 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca700-790f-4cac-99d3-3c92a454da3b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.385512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca700-790f-4cac-99d3-3c92a454da3b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.385783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca700-790f-4cac-99d3-3c92a454da3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.386522 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca700-790f-4cac-99d3-3c92a454da3b None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=f055d496950c4414934e2d6ab6d1e9b6, user.id=92822546e550407093c49b31ab90554f) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:26.386830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca700-790f-4cac-99d3-3c92a454da3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:26.388336 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca700-790f-4cac-99d3-3c92a454da3b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:26.395690 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 579/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:26 2022] GET /identity/v3/role_assignments?user.id=92822546e550407093c49b31ab90554f&scope.project.id=f055d496950c4414934e2d6ab6d1e9b6&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:28.335885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab3d99-9533-4444-8dc3-cd1058d8f23d None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:28.336422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab3d99-9533-4444-8dc3-cd1058d8f23d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:28.336422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab3d99-9533-4444-8dc3-cd1058d8f23d None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:28.338011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 583/1162] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:28.343257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ee67-5c36-4231-8b15-ef5c050f7e78 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:28.343624 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ee67-5c36-4231-8b15-ef5c050f7e78 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:28.343860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ee67-5c36-4231-8b15-ef5c050f7e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:28.362783 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-89b1ee67-5c36-4231-8b15-ef5c050f7e78 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:28.364015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-89b1ee67-5c36-4231-8b15-ef5c050f7e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:28.378463 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:28.441573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 580/1163] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:28.709278 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab3d99-9533-4444-8dc3-cd1058d8f23d None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:28.815538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab3d99-9533-4444-8dc3-cd1058d8f23d None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:28.848032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:28.848626 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:28.848902 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:28.849173 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:28.883463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:28.914705 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:28.916296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:29.010688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 584/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:29.016609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ee67-5c36-4231-8b15-ef5c050f7e78 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.116187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ee67-5c36-4231-8b15-ef5c050f7e78 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:29.149080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329782b-99b3-4187-adde-c6f34e8dc0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:29.149694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329782b-99b3-4187-adde-c6f34e8dc0fe None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.149969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329782b-99b3-4187-adde-c6f34e8dc0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.150237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329782b-99b3-4187-adde-c6f34e8dc0fe None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.156613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329782b-99b3-4187-adde-c6f34e8dc0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:29.158089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329782b-99b3-4187-adde-c6f34e8dc0fe None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a329782b-99b3-4187-adde-c6f34e8dc0fe None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:29.169033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:29.170080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:48:29.171068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 581/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:29.176152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.240125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:29.272604 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade77b12-6eb8-4987-bfad-4267ac3b2c83 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:29.304767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975fc81-2ab3-481f-b339-24461cfb0c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:29.305360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975fc81-2ab3-481f-b339-24461cfb0c72 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.305634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975fc81-2ab3-481f-b339-24461cfb0c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.305903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975fc81-2ab3-481f-b339-24461cfb0c72 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.306535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975fc81-2ab3-481f-b339-24461cfb0c72 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:29.306835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975fc81-2ab3-481f-b339-24461cfb0c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:29.308214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975fc81-2ab3-481f-b339-24461cfb0c72 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:29.315690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 585/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:31.197974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21562b-397d-451b-83ec-80e7ccb2b265 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.198715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21562b-397d-451b-83ec-80e7ccb2b265 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.198715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21562b-397d-451b-83ec-80e7ccb2b265 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.199904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 582/1167] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:31.205975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16610cd-8051-4bbc-99cc-69ead144c4be None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.206511 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16610cd-8051-4bbc-99cc-69ead144c4be None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.206511 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16610cd-8051-4bbc-99cc-69ead144c4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.226023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b16610cd-8051-4bbc-99cc-69ead144c4be None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:31.227239 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b16610cd-8051-4bbc-99cc-69ead144c4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:31.291700 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 586/1168] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:31.561383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21562b-397d-451b-83ec-80e7ccb2b265 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:31.573151 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:31.664186 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21562b-397d-451b-83ec-80e7ccb2b265 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:31.697064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3263cc6-6506-41ff-9c58-4289cf7a72c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:31.697660 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3263cc6-6506-41ff-9c58-4289cf7a72c8 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.697937 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3263cc6-6506-41ff-9c58-4289cf7a72c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.698209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3263cc6-6506-41ff-9c58-4289cf7a72c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.698865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3263cc6-6506-41ff-9c58-4289cf7a72c8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:31.700260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3263cc6-6506-41ff-9c58-4289cf7a72c8 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:31.778856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 583/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Sun Aug 28 00:48:31 2022] POST /identity/v3/domains => generated 267 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:48:33.696776 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c734ad2-3682-48bf-a53b-6a44d3a70411 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:33.697192 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c734ad2-3682-48bf-a53b-6a44d3a70411 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:33.697306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c734ad2-3682-48bf-a53b-6a44d3a70411 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:33.698697 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 587/1170] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:33.704756 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485c7f8-61be-4e8b-a5b8-7be74d2517d3 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:33.707765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485c7f8-61be-4e8b-a5b8-7be74d2517d3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:33.707765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485c7f8-61be-4e8b-a5b8-7be74d2517d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:33.723890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0485c7f8-61be-4e8b-a5b8-7be74d2517d3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:33.725154 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0485c7f8-61be-4e8b-a5b8-7be74d2517d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:33.786415 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:33.791904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 584/1171] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:34.064416 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c734ad2-3682-48bf-a53b-6a44d3a70411 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.125391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:34.165814 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c734ad2-3682-48bf-a53b-6a44d3a70411 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.199727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6311b6-5e05-4082-8b85-bd55d17b3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.200345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6311b6-5e05-4082-8b85-bd55d17b3a7f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.200621 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6311b6-5e05-4082-8b85-bd55d17b3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.200893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6311b6-5e05-4082-8b85-bd55d17b3a7f None admin] PATH_INFO: `/v3/domains/061ab86ee367468b865d80ff929e7d86` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.211960 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6311b6-5e05-4082-8b85-bd55d17b3a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=061ab86ee367468b865d80ff929e7d86)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:34.213399 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6311b6-5e05-4082-8b85-bd55d17b3a7f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:34.214979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 588/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/domains/061ab86ee367468b865d80ff929e7d86 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:34.221488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485c7f8-61be-4e8b-a5b8-7be74d2517d3 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.317280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485c7f8-61be-4e8b-a5b8-7be74d2517d3 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.351534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676776f-3eea-4610-9ba9-a27ff9b664ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.352129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676776f-3eea-4610-9ba9-a27ff9b664ff None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.352408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676776f-3eea-4610-9ba9-a27ff9b664ff None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.352684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676776f-3eea-4610-9ba9-a27ff9b664ff None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.353337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676776f-3eea-4610-9ba9-a27ff9b664ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:34.354766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676776f-3eea-4610-9ba9-a27ff9b664ff None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:34.418373 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 585/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:48:34 2022] POST /identity/v3/projects => generated 361 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:48:36.355924 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c070-31be-448b-8218-2f1db3e63cce None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:36.356449 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c070-31be-448b-8218-2f1db3e63cce None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:36.356568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c070-31be-448b-8218-2f1db3e63cce None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:36.357803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 589/1174] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:36.363196 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c67695-5e9e-47e7-8963-9ac433855810 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:36.363620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c67695-5e9e-47e7-8963-9ac433855810 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:36.363830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c67695-5e9e-47e7-8963-9ac433855810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:36.382214 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c9c67695-5e9e-47e7-8963-9ac433855810 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:36.383437 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c9c67695-5e9e-47e7-8963-9ac433855810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:36.429021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:36.448837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 586/1175] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:36.737541 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c070-31be-448b-8218-2f1db3e63cce None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:36.838289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c070-31be-448b-8218-2f1db3e63cce None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:36.859969 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:36.871019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c13a3-aff2-441f-bbd8-1a59094f52d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:36.871664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c13a3-aff2-441f-bbd8-1a59094f52d3 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:36.871940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c13a3-aff2-441f-bbd8-1a59094f52d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:36.872213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c13a3-aff2-441f-bbd8-1a59094f52d3 None admin] PATH_INFO: `/v3/domains/061ab86ee367468b865d80ff929e7d86` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:36.873334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c13a3-aff2-441f-bbd8-1a59094f52d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=061ab86ee367468b865d80ff929e7d86)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:36.874749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c13a3-aff2-441f-bbd8-1a59094f52d3 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:36.877791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 590/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Sun Aug 28 00:48:36 2022] GET /identity/v3/domains/061ab86ee367468b865d80ff929e7d86 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:36.883648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c67695-5e9e-47e7-8963-9ac433855810 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:36.978655 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c67695-5e9e-47e7-8963-9ac433855810 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:37.011894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a193721-3594-4af4-877e-38e4fd0b6120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:37.012491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193721-3594-4af4-877e-38e4fd0b6120 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:37.012769 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193721-3594-4af4-877e-38e4fd0b6120 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:37.013054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193721-3594-4af4-877e-38e4fd0b6120 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:37.013699 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a193721-3594-4af4-877e-38e4fd0b6120 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:37.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a193721-3594-4af4-877e-38e4fd0b6120 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:37.123947 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 587/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:48:36 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:48:39.095129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c83987-b034-46f9-a4cd-848beb0a5664 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.095723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c83987-b034-46f9-a4cd-848beb0a5664 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.095723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c83987-b034-46f9-a4cd-848beb0a5664 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.097042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 591/1178] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:39.102378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6de3a-fffb-44ce-ab56-3e94f7d04a96 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.102812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6de3a-fffb-44ce-ab56-3e94f7d04a96 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.102920 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6de3a-fffb-44ce-ab56-3e94f7d04a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.120705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3df6de3a-fffb-44ce-ab56-3e94f7d04a96 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:39.121925 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3df6de3a-fffb-44ce-ab56-3e94f7d04a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:39.151070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.189181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 588/1179] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:39.460854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c83987-b034-46f9-a4cd-848beb0a5664 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.561565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c83987-b034-46f9-a4cd-848beb0a5664 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.595430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.596046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.596319 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.596587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.606705 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:39.611578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:39.612946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:48:39.614174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 592/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:39.618763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6de3a-fffb-44ce-ab56-3e94f7d04a96 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.720324 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6de3a-fffb-44ce-ab56-3e94f7d04a96 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.753725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.754327 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.754606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.754876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.755561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:39.755865 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.757229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.765091 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 589/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:39.771764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.820384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.869606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c74d1-6cd0-4e7c-bb9f-867fc5becaa9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.903449 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.904067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.904343 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.904614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] PATH_INFO: `/v3/users/531aaae82adf46f18b6d7878eebf3a12` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.917589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] RBAC: Authorizing `identity:get_user(user_id=531aaae82adf46f18b6d7878eebf3a12)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.919018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.920649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 593/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/users/531aaae82adf46f18b6d7878eebf3a12 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:39.926888 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.955899 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:40.026511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b7754-34a3-4dc1-8ead-87c812ff265b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:40.060506 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:40.061169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:40.061446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:40.061715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:40.129820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:40.131296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:40.158820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:40.229973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 590/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:40.236519 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:40.333632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5de47-7e4f-4a85-b22d-6ca856c9481a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:40.343717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:40.370188 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454265b-2f25-4608-959c-413ebafa7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:40.370819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454265b-2f25-4608-959c-413ebafa7424 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:40.371113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454265b-2f25-4608-959c-413ebafa7424 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:40.371396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454265b-2f25-4608-959c-413ebafa7424 None admin] PATH_INFO: `/v3/projects/ab1099bde279430d964e8f690d9fa74f` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:40.372514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454265b-2f25-4608-959c-413ebafa7424 None admin] RBAC: Authorizing `identity:get_project(project_id=ab1099bde279430d964e8f690d9fa74f)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:40.373941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454265b-2f25-4608-959c-413ebafa7424 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:40.375623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 594/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:40 2022] GET /identity/v3/projects/ab1099bde279430d964e8f690d9fa74f => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:40.381866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:40.480776 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfbdb3-bb19-41c4-9173-b56025cdc05f None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:40.507171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:40.514665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465a4c8-c735-4af1-83f3-87713aab4490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:40.515295 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465a4c8-c735-4af1-83f3-87713aab4490 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:40.521007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465a4c8-c735-4af1-83f3-87713aab4490 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:40.521007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465a4c8-c735-4af1-83f3-87713aab4490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:40.521007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465a4c8-c735-4af1-83f3-87713aab4490 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=ab1099bde279430d964e8f690d9fa74f, user.id=531aaae82adf46f18b6d7878eebf3a12) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:40.521007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465a4c8-c735-4af1-83f3-87713aab4490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:40.521007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465a4c8-c735-4af1-83f3-87713aab4490 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:40.523871 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 591/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:40 2022] GET /identity/v3/role_assignments?user.id=531aaae82adf46f18b6d7878eebf3a12&scope.project.id=ab1099bde279430d964e8f690d9fa74f&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:42.407063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bb86-30e7-4adf-b316-b8835a030f44 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:42.407657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bb86-30e7-4adf-b316-b8835a030f44 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:42.407657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bb86-30e7-4adf-b316-b8835a030f44 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:42.409017 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 595/1186] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:48:42.414425 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed1fd-b052-4156-a40b-c629087e2a68 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:42.414882 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed1fd-b052-4156-a40b-c629087e2a68 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:42.414992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed1fd-b052-4156-a40b-c629087e2a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:42.434316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-49fed1fd-b052-4156-a40b-c629087e2a68 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:42.435562 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-49fed1fd-b052-4156-a40b-c629087e2a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:42.502810 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 592/1187] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:42.776508 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bb86-30e7-4adf-b316-b8835a030f44 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:42.874747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bb86-30e7-4adf-b316-b8835a030f44 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:42.908701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:42.909314 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:42.909589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:42.909858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:42.919690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:42.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:42.925512 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:48:42.926376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 596/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:42.931570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed1fd-b052-4156-a40b-c629087e2a68 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.028508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed1fd-b052-4156-a40b-c629087e2a68 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.051450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:43.062785 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.063916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.064195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.064531 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.065198 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:43.065500 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.066859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.075388 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 593/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:43.081969 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.116135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:43.179384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cac65-03a5-45b1-afc2-ea91d06e2bbe None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.212926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.213540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.213814 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.214082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] PATH_INFO: `/v3/users/531aaae82adf46f18b6d7878eebf3a12` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.215219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] RBAC: Authorizing `identity:get_user(user_id=531aaae82adf46f18b6d7878eebf3a12)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.216638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.218199 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 597/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/users/531aaae82adf46f18b6d7878eebf3a12 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:43.224158 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.322233 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dee5-80a0-4bac-840e-6f465b0198aa None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.355585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cea109-ecef-4261-91b6-7e3ea60a00cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.356207 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea109-ecef-4261-91b6-7e3ea60a00cd None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.356483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea109-ecef-4261-91b6-7e3ea60a00cd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.356755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea109-ecef-4261-91b6-7e3ea60a00cd None admin] PATH_INFO: `/v3/projects/ab1099bde279430d964e8f690d9fa74f` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.357860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cea109-ecef-4261-91b6-7e3ea60a00cd None admin] RBAC: Authorizing `identity:get_project(project_id=ab1099bde279430d964e8f690d9fa74f)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.359315 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cea109-ecef-4261-91b6-7e3ea60a00cd None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.361159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 594/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/projects/ab1099bde279430d964e8f690d9fa74f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:43.367297 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.464527 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c56a-1973-46b2-880a-b8485b4949f4 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.466723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:43.498643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448097c-43e0-4f8e-8021-6890039f4c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.499321 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448097c-43e0-4f8e-8021-6890039f4c7b None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.499600 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448097c-43e0-4f8e-8021-6890039f4c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.499893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448097c-43e0-4f8e-8021-6890039f4c7b None admin] PATH_INFO: `/v3/projects/ab1099bde279430d964e8f690d9fa74f/users/531aaae82adf46f18b6d7878eebf3a12/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.502473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448097c-43e0-4f8e-8021-6890039f4c7b None admin] RBAC: Authorizing `identity:create_grant(project_id=ab1099bde279430d964e8f690d9fa74f, user_id=531aaae82adf46f18b6d7878eebf3a12, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.503926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448097c-43e0-4f8e-8021-6890039f4c7b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.577021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 598/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:48:43 2022] PUT /identity/v3/projects/ab1099bde279430d964e8f690d9fa74f/users/531aaae82adf46f18b6d7878eebf3a12/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:48:45.462631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f900561-5919-4e1c-b581-10731ea59847 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:45.463229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f900561-5919-4e1c-b581-10731ea59847 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:45.463471 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f900561-5919-4e1c-b581-10731ea59847 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:45.464890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 595/1193] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:45.470882 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554a352-7817-428b-b7f5-964f608a4896 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:45.471344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554a352-7817-428b-b7f5-964f608a4896 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:45.471452 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554a352-7817-428b-b7f5-964f608a4896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:45.489019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-d554a352-7817-428b-b7f5-964f608a4896 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:45.490214 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d554a352-7817-428b-b7f5-964f608a4896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:45.555760 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 599/1194] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:45.831649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f900561-5919-4e1c-b581-10731ea59847 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:45.885168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:45.933255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f900561-5919-4e1c-b581-10731ea59847 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:45.967651 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:45.968277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:45.968554 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:45.968824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:45.978959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:45.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:45.985894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:48:45.987051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 596/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:45.992353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554a352-7817-428b-b7f5-964f608a4896 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:46.084623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:46.091520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554a352-7817-428b-b7f5-964f608a4896 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:46.125958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:46.126608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:46.127079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:46.127729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:46.128406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:46.128711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:46.130065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:46.138691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 600/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:46.144797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:46.243114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2d9dd-94a9-4bfe-9846-7597d1816c0b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:46.256392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:46.276890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:46.277509 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:46.277784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:46.278054 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] PATH_INFO: `/v3/users/531aaae82adf46f18b6d7878eebf3a12` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:46.279291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] RBAC: Authorizing `identity:get_user(user_id=531aaae82adf46f18b6d7878eebf3a12)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:46.281075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:46.283189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 597/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Sun Aug 28 00:48:46 2022] GET /identity/v3/users/531aaae82adf46f18b6d7878eebf3a12 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:46.289022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:46.386925 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ccc1-9efe-4a73-b8ce-cc0f2882f2e9 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:46.419232 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:46.419825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:46.420100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:46.420370 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:46.444195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:46.486298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:46.487763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:46.583019 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 601/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:46.589367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:46.687092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfe47-7b77-48fb-8e0f-6321106b0450 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:46.720685 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd611f8f-8e2b-430f-ba5a-7bc92fc1894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:46.721309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611f8f-8e2b-430f-ba5a-7bc92fc1894b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:46.721587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611f8f-8e2b-430f-ba5a-7bc92fc1894b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:46.721860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611f8f-8e2b-430f-ba5a-7bc92fc1894b None admin] PATH_INFO: `/v3/projects/ab1099bde279430d964e8f690d9fa74f` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:46.722961 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd611f8f-8e2b-430f-ba5a-7bc92fc1894b None admin] RBAC: Authorizing `identity:get_project(project_id=ab1099bde279430d964e8f690d9fa74f)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:46.724419 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd611f8f-8e2b-430f-ba5a-7bc92fc1894b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:46.726026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 598/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Sun Aug 28 00:48:46 2022] GET /identity/v3/projects/ab1099bde279430d964e8f690d9fa74f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:46.732396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:46.791168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:46.834298 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45673b2a-0044-4f69-8500-e513a11dfe02 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:46.870857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1301b67-3897-4883-b669-d31734109792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:46.871495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1301b67-3897-4883-b669-d31734109792 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:46.871771 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1301b67-3897-4883-b669-d31734109792 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:46.872040 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1301b67-3897-4883-b669-d31734109792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:46.872765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1301b67-3897-4883-b669-d31734109792 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=ab1099bde279430d964e8f690d9fa74f, user.id=531aaae82adf46f18b6d7878eebf3a12) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:46.873071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1301b67-3897-4883-b669-d31734109792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:46.874478 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1301b67-3897-4883-b669-d31734109792 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:46.880897 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 602/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:46 2022] GET /identity/v3/role_assignments?user.id=531aaae82adf46f18b6d7878eebf3a12&scope.project.id=ab1099bde279430d964e8f690d9fa74f&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:56.716271 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=76 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:56.878274 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=40 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:03.004728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8f5b-1718-461d-8b6b-64d8f27534f6 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:03.005317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8f5b-1718-461d-8b6b-64d8f27534f6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:03.005317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8f5b-1718-461d-8b6b-64d8f27534f6 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:03.006638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 599/1201] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:03.012020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796fd59-dc30-4473-84b5-741dd87293dd None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:03.012419 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796fd59-dc30-4473-84b5-741dd87293dd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:03.012553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796fd59-dc30-4473-84b5-741dd87293dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:03.030307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-2796fd59-dc30-4473-84b5-741dd87293dd None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:03.032082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2796fd59-dc30-4473-84b5-741dd87293dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:03.097959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 603/1202] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:03.372124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8f5b-1718-461d-8b6b-64d8f27534f6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:03.480036 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8f5b-1718-461d-8b6b-64d8f27534f6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:03.515150 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:03.515784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:03.516062 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:03.516333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:03.527263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:03.531032 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:03.543261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:03.544314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:03.545403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:03.545403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:03.545403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:03.545403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 600/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:03.551183 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796fd59-dc30-4473-84b5-741dd87293dd None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:03.648396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796fd59-dc30-4473-84b5-741dd87293dd None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:03.678500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:03.684317 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52a464-2ddd-45f5-a7b5-116627843174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:03.684947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52a464-2ddd-45f5-a7b5-116627843174 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:03.685222 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52a464-2ddd-45f5-a7b5-116627843174 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:03.685493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52a464-2ddd-45f5-a7b5-116627843174 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:03.686143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52a464-2ddd-45f5-a7b5-116627843174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:03.686430 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52a464-2ddd-45f5-a7b5-116627843174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:03.687918 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52a464-2ddd-45f5-a7b5-116627843174 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:03.698982 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 604/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:03.705409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:03.758545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:03.806422 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf4012-2331-4f4e-8e09-00f36f75ef66 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:03.840392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f967059-b9ec-4c3d-8c9d-ea9638ba988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:03.841000 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f967059-b9ec-4c3d-8c9d-ea9638ba988f None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:03.841279 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f967059-b9ec-4c3d-8c9d-ea9638ba988f None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:03.841552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f967059-b9ec-4c3d-8c9d-ea9638ba988f None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:03.842191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f967059-b9ec-4c3d-8c9d-ea9638ba988f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:03.844221 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f967059-b9ec-4c3d-8c9d-ea9638ba988f None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:03.961236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 601/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Sun Aug 28 00:50:03 2022] POST /identity/v3/users => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:50:05.899227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea946b7-981c-4120-b745-0394bd83ea5b None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:05.899741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea946b7-981c-4120-b745-0394bd83ea5b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:05.899857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea946b7-981c-4120-b745-0394bd83ea5b None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:05.901134 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 605/1206] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:05.907034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261e12-9784-42fe-a616-1eaf99e1cbf2 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:05.907571 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261e12-9784-42fe-a616-1eaf99e1cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:05.907667 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261e12-9784-42fe-a616-1eaf99e1cbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:05.926787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-63261e12-9784-42fe-a616-1eaf99e1cbf2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:05.927946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-63261e12-9784-42fe-a616-1eaf99e1cbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:05.995762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 602/1207] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:06.265492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea946b7-981c-4120-b745-0394bd83ea5b None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:06.367828 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea946b7-981c-4120-b745-0394bd83ea5b None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:06.404057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:06.404701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:06.404978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:06.405938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:06.416896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:06.422020 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:06.423140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:06.424109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 606/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:06.429331 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261e12-9784-42fe-a616-1eaf99e1cbf2 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:06.468679 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:06.525806 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261e12-9784-42fe-a616-1eaf99e1cbf2 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:06.558512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:06.559155 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:06.565301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:06.565301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:06.565301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:06.565301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:06.565301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:06.570508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 603/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:06.576411 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:06.627062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:06.676266 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9a117-6104-4e41-a044-369f8e30f04c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:06.710902 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:06.711553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:06.711850 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:06.712099 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:06.723313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:06.725297 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:06.738498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:06.739798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:06.740884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:06.740884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:06.740884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:06.740884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 607/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:06.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:06.845705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:06.848746 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b43ba-3f82-4353-9601-ddb82379d476 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:06.881969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:06.882569 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:06.882843 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:06.883130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:06.883763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:06.884059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:06.885505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:06.897182 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 604/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:06.902969 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:07.002265 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db442aa-99ad-4237-bc30-9ea0fc5bfe60 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:07.003801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:07.035987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:07.036603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:07.036877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:07.037146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:07.044671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:07.046762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:50:07.060860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:07.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:07.064638 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 608/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:50:07.068736 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:07.171691 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd839d-261f-4657-a6d7-1ec3d2fec7c9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:07.207644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:07.208256 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:07.208537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:07.208812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:07.209531 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:07.209835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:07.211375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:07.230573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 605/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Sun Aug 28 00:50:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:07.234913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:07.333852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a90b-d098-42e1-a815-92cb3289f872 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:07.368040 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:07.368636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:07.368910 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:07.369243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:07.399032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:07.441037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:07.442393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:07.541011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 609/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:50:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:50:07.546936 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:07.566526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:07.645903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba18d6-013f-4622-b086-f491f21f3028 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:07.684727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:07.685352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:07.685629 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:07.685898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:07.696806 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:07.698184 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:07.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:07.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:07.715306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:07.715306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:07.715306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:07.715306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 606/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:07.720170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:07.781480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:07.819819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1658-7bf9-41f3-abce-86f058c99b8f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:07.852949 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:07.853550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:07.853825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:07.854093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:07.854726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:07.855037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:07.856458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:07.867928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 610/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:07.873668 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:07.944711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:07.974619 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba2187-8093-44ac-be09-d56b4231f7fb None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:08.008948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:08.009573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:08.009847 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:08.010116 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:08.017124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:08.018556 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:50:08.029508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:08.031330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:08.032426 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 607/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:08.037115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:08.143288 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55754e7-03b1-4286-a833-ff593522d8dd None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:08.165996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:08.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea04535-fcb4-4870-84a9-21ecf75a8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:08.178946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04535-fcb4-4870-84a9-21ecf75a8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:08.179258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04535-fcb4-4870-84a9-21ecf75a8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:08.179536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04535-fcb4-4870-84a9-21ecf75a8ad2 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:08.180225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea04535-fcb4-4870-84a9-21ecf75a8ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:08.180534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea04535-fcb4-4870-84a9-21ecf75a8ad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:08.181960 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea04535-fcb4-4870-84a9-21ecf75a8ad2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:08.194873 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 611/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:08.201125 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:08.302204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caacbd-7b49-4fd1-a4a6-47ee0701c39b None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:08.329614 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:08.335398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30a98f-572a-41b7-8636-04c62a2e308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:08.335998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a98f-572a-41b7-8636-04c62a2e308d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:08.336294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a98f-572a-41b7-8636-04c62a2e308d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:08.336543 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a98f-572a-41b7-8636-04c62a2e308d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:08.337255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30a98f-572a-41b7-8636-04c62a2e308d None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71de6ef4ed504cfe8289c8ec519405bc) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:08.337560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30a98f-572a-41b7-8636-04c62a2e308d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:08.338977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30a98f-572a-41b7-8636-04c62a2e308d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:08.344905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 608/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:50:08 2022] GET /identity/v3/role_assignments?user.id=71de6ef4ed504cfe8289c8ec519405bc&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:10.323605 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36119-8521-40e1-88d4-cd7020b34d5f None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:10.324224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36119-8521-40e1-88d4-cd7020b34d5f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:10.324224 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36119-8521-40e1-88d4-cd7020b34d5f None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:10.325496 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 612/1220] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:10.331304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6f3d-b724-4cc9-8bb6-68b832cf84f6 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:10.331994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6f3d-b724-4cc9-8bb6-68b832cf84f6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:10.332091 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6f3d-b724-4cc9-8bb6-68b832cf84f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:10.350264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-ebab6f3d-b724-4cc9-8bb6-68b832cf84f6 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:10.351512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ebab6f3d-b724-4cc9-8bb6-68b832cf84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:10.420208 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 609/1221] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:10.690941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36119-8521-40e1-88d4-cd7020b34d5f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:10.792717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36119-8521-40e1-88d4-cd7020b34d5f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:10.826053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:10.826679 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:10.827530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:10.827801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] PATH_INFO: `/v3/roles/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:10.838125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:10.843540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:10.844777 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:10.846016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 613/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:50:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:10.850739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6f3d-b724-4cc9-8bb6-68b832cf84f6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:10.954063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6f3d-b724-4cc9-8bb6-68b832cf84f6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:10.977715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:10.988349 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:10.989561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:10.989561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:10.989561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:10.990122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:10.990423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:10.991818 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.000104 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 610/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:50:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:11.005921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.050363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:11.105808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001c3-6c84-4d8a-b36b-14c1cab36bde None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:11.138888 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:11.142185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.142185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.142185 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.150485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:11.151932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:11.166369 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:11.167433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:11.168440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:11.168440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:11.168440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:11.168440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 614/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:11.173978 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.273425 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee0dc-b074-4589-9a29-1677555265d2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:11.306738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:11.307360 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.307636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.307945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.308600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:11.308901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:11.310250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.321665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 611/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:11.327495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.421654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:11.429216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4951779-9f7e-43b6-b2a4-5b936fb8222a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:11.462601 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:11.463261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.463540 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.463814 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.471780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:11.473239 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:50:11.484402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:11.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:11.486819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 615/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:11.491642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.541085 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:11.593448 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16835-ce61-4858-91f0-8ab1ff56f5b1 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:11.628856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:11.629454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.629730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.630001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.630713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:11.631013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:11.632559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.649443 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 612/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:11.655114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.754826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121ca9-c802-4f62-8235-09563812a316 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:11.787970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:11.788580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.788855 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.789125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.799344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:11.800718 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:11.815374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:11.816591 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:11.817597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:11.817597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:11.817597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:11.817597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 616/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:11.823051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.922183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026f96-49ac-4a5d-a5dd-c3a14aca4589 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:11.924473 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:11.955898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:11.956748 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.957024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.957291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.957915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:11.958211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:11.959622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.970985 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 613/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:11.976564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.985984 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:12.077444 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eef03-6697-4949-a918-54d71269a55c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:12.111770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:12.112394 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:12.112669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:12.112940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:12.119433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:12.120863 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:50:12.132491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:12.133570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:12.134821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 617/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:12.139514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:12.238350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489c4b-811d-47b5-bd46-755952d6af03 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:12.272422 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966a8b5-39f2-483c-92b4-2e994c3ce345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:12.273066 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966a8b5-39f2-483c-92b4-2e994c3ce345 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:12.273342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966a8b5-39f2-483c-92b4-2e994c3ce345 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:12.273612 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966a8b5-39f2-483c-92b4-2e994c3ce345 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:12.274288 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966a8b5-39f2-483c-92b4-2e994c3ce345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:12.274590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966a8b5-39f2-483c-92b4-2e994c3ce345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:12.276046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966a8b5-39f2-483c-92b4-2e994c3ce345 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:12.287884 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 614/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:12.294038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:12.360717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:12.395322 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06486e-b16c-4cd3-bee4-56d28597edd6 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:12.432008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41e1da-98d7-42c1-a948-b50ebeb464d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:12.432665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41e1da-98d7-42c1-a948-b50ebeb464d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:12.432943 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41e1da-98d7-42c1-a948-b50ebeb464d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:12.433243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41e1da-98d7-42c1-a948-b50ebeb464d2 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/71de6ef4ed504cfe8289c8ec519405bc/roles/826c400ad3c34b06933206c5b981d0b0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:12.448097 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41e1da-98d7-42c1-a948-b50ebeb464d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=71de6ef4ed504cfe8289c8ec519405bc, role_id=826c400ad3c34b06933206c5b981d0b0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:12.449536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41e1da-98d7-42c1-a948-b50ebeb464d2 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:12.543197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 618/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:50:12 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/71de6ef4ed504cfe8289c8ec519405bc/roles/826c400ad3c34b06933206c5b981d0b0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:50:14.452997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff752c6-27c4-4fb7-b9bc-a5c8376c75a7 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:14.453548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff752c6-27c4-4fb7-b9bc-a5c8376c75a7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:14.453548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff752c6-27c4-4fb7-b9bc-a5c8376c75a7 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:14.454894 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 615/1233] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:14.460672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d3e2-1186-4bd9-9a1d-5a17b6c66151 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:14.461063 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d3e2-1186-4bd9-9a1d-5a17b6c66151 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:14.461218 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d3e2-1186-4bd9-9a1d-5a17b6c66151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:14.479729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-4ee8d3e2-1186-4bd9-9a1d-5a17b6c66151 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:14.480939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-4ee8d3e2-1186-4bd9-9a1d-5a17b6c66151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:14.548778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 619/1234] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:14.820265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff752c6-27c4-4fb7-b9bc-a5c8376c75a7 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:14.848047 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:14.923927 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff752c6-27c4-4fb7-b9bc-a5c8376c75a7 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:14.958701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:14.959362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:14.959645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:14.959939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:14.970059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:14.974852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:14.976040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:14.976954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 616/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Sun Aug 28 00:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:14.982114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d3e2-1186-4bd9-9a1d-5a17b6c66151 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:15.027672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:15.080146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d3e2-1186-4bd9-9a1d-5a17b6c66151 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:15.114780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:15.115414 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:15.115690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:15.115958 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:15.116611 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] RBAC: Adding query filter params (name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:15.116910 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:15.118251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:15.126651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 620/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Sun Aug 28 00:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:15.140169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:15.225812 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:15.241682 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5053c20-e812-4c0b-bf12-28fecbd724e2 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:15.275477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:15.276093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:15.276365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:15.276633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:15.286653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:15.288102 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:15.303009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:15.304209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:15.305341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:15.305341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:15.305341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:15.305341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 617/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:15.310043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:15.412229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb142-59b6-45f8-b728-1ba931871fae None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:15.421159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:15.445983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:15.446587 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:15.446860 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:15.447159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:15.447821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:15.448121 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:15.449524 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:15.461849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 621/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:15.468086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:15.568942 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a3919-6b66-433c-8e62-6e11c05d6cb3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:15.603071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:15.603721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:15.603998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:15.604269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:15.607004 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:15.611987 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:15.613417 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:50:15.625924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:15.627129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:15.628455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 618/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:15.633133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:15.734884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd0097-4004-4868-a7cb-d6f2e2975a39 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:15.769021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:15.769653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:15.769935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:15.770200 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:15.770923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:15.771260 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:15.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:15.789693 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 622/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Sun Aug 28 00:50:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:15.795436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:15.899068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7953fd-8360-4e18-97da-0426d7ad5703 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:15.941209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:15.941209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:15.941209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:15.941209 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:15.998967 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:16.006269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:16.007767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:16.106411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 619/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:50:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:50:16.112937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:16.139772 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:16.212664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62dd6c-0153-4e84-a33b-da282cc9e233 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:16.247375 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:16.248003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:16.248280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:16.248558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:16.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:16.260391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:16.279484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:16.280642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:16.281892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:16.281892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:16.281892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:16.281892 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 623/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:16.286724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:16.380651 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:16.386668 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05c41-c68a-4b69-b824-839aece1b2ef None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:16.420608 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:16.421215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:16.421495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:16.421793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:16.422431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:16.422735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:16.424237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:16.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 620/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:16.442213 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:16.522787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:16.543699 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f592a6b-0f26-4fc0-9a5c-986819e5856f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:16.576225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:16.576914 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:16.577188 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:16.577459 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:16.585436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:16.586955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:50:16.598488 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:16.599615 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:16.600798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 624/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:50:16.605774 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:16.709695 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dd7fb-bd76-41d5-a256-938b77d481dd None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:16.743409 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3defec1-ef84-405d-aaa8-351e5ac08ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:16.744014 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3defec1-ef84-405d-aaa8-351e5ac08ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:16.744294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3defec1-ef84-405d-aaa8-351e5ac08ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:16.744570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3defec1-ef84-405d-aaa8-351e5ac08ef2 None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:16.745260 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3defec1-ef84-405d-aaa8-351e5ac08ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:16.745564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3defec1-ef84-405d-aaa8-351e5ac08ef2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:16.746989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3defec1-ef84-405d-aaa8-351e5ac08ef2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:16.759319 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 621/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:16.765968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:16.869899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0e1d-3814-4f45-84d4-31f77936d3bf None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:16.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c11b9-f249-4ff2-b77b-a1a089e50137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:16.905401 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c11b9-f249-4ff2-b77b-a1a089e50137 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:16.905674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c11b9-f249-4ff2-b77b-a1a089e50137 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:16.905946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c11b9-f249-4ff2-b77b-a1a089e50137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:16.906812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c11b9-f249-4ff2-b77b-a1a089e50137 None admin] RBAC: Adding query filter params (role.id=826c400ad3c34b06933206c5b981d0b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71de6ef4ed504cfe8289c8ec519405bc) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:16.907144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c11b9-f249-4ff2-b77b-a1a089e50137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:16.908573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c11b9-f249-4ff2-b77b-a1a089e50137 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:16.914178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 625/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:50:16 2022] GET /identity/v3/role_assignments?user.id=71de6ef4ed504cfe8289c8ec519405bc&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=826c400ad3c34b06933206c5b981d0b0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:18.952174 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db390-ba90-4995-8fa4-365862bc554e None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:18.952693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db390-ba90-4995-8fa4-365862bc554e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:18.952693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db390-ba90-4995-8fa4-365862bc554e None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:18.954022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 622/1247] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:18.959726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991ae6-f107-4183-b645-537b63f77ff1 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:18.960158 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991ae6-f107-4183-b645-537b63f77ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:18.960272 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991ae6-f107-4183-b645-537b63f77ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:18.966498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:18.978677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-f7991ae6-f107-4183-b645-537b63f77ff1 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:18.980435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-f7991ae6-f107-4183-b645-537b63f77ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:19.046258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 626/1248] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:19.316902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52db390-ba90-4995-8fa4-365862bc554e None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:19.335692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:19.421066 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52db390-ba90-4995-8fa4-365862bc554e None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:19.456471 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:19.457101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:19.457378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:19.457649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:19.467939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:19.473478 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:19.474628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:19.475678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 623/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:19.481031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991ae6-f107-4183-b645-537b63f77ff1 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:19.582861 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991ae6-f107-4183-b645-537b63f77ff1 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:19.622410 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:19.627461 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:19.628096 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:19.628426 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:19.628700 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:19.629419 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:19.629719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:19.631078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:19.639059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 627/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:19.645504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:19.725809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:19.749309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a476-1ab0-466e-b518-a64e4cba2d9d None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:19.787615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:19.788269 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:19.788545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:19.788809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:19.800254 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:19.808462 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:19.817514 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:19.818797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:19.819798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:19.819798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:19.819798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:19.819798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 624/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:19.825008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:19.927618 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659203d6-0d13-43b7-8190-81bddc36cb6c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:19.961778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:19.962406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:19.962639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:19.962908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:19.963577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:19.963875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:19.965227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:19.976698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 628/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:19.982808 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:20.082308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc05b4-2a51-49c3-a8df-fd912827c2b3 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:20.107261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:20.114953 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:20.115589 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.115866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.116135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.123417 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:20.125383 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:50:20.136258 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:20.151005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:20.152225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 625/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:50:20.152852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:20.199255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:20.243045 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb70d8-a6ba-4685-a3df-e47d2670743f None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:20.277570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:20.278207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.278481 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.278748 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.279502 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:20.279837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:20.281445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:20.298296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 629/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Sun Aug 28 00:50:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:20.304204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:20.412804 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825231-f89e-4a7d-b138-56cce58701ef None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:20.447077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:20.447701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.447982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.448255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.504964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:20.517771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:20.519328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:20.620464 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 626/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:50:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:50:20.627091 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:20.725608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7315-fac7-48c6-9379-f63758f1228d None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:20.738801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:20.759995 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:20.760567 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.760842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.761113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.773385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:20.774937 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:20.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:20.794835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:20.796004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:20.796004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:20.796004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:20.796004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 630/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:20.798766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:20.899457 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:20.912387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd19bd-cb8f-47a0-a347-d3e9629793f5 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:20.948734 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:20.949356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.949700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.949973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.950622 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:20.950921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:20.952341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:20.966124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 627/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:20.972295 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:21.079894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf367b-7749-44b9-9dbc-3cbcc48743a8 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:21.115572 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:21.116197 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:21.116467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:21.116733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:21.123499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:21.125494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:50:21.136744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:21.137883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:21.138805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 631/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:21.144024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:21.245725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793e503-3466-4ce6-b8b3-d274d2322047 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:21.279356 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca3957-d224-4147-aff7-0087281f1a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:21.279959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3957-d224-4147-aff7-0087281f1a0d None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:21.280236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3957-d224-4147-aff7-0087281f1a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:21.280507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3957-d224-4147-aff7-0087281f1a0d None admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:21.281784 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca3957-d224-4147-aff7-0087281f1a0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:21.282092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca3957-d224-4147-aff7-0087281f1a0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:21.283540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca3957-d224-4147-aff7-0087281f1a0d None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:21.295407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 628/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:21.301811 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:21.327416 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:21.401036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd75bd-1d82-4b22-a8d8-327a2aa41cc5 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:21.439172 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca398bd3-4d76-4c64-8ef7-26172755c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:21.439783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398bd3-4d76-4c64-8ef7-26172755c287 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:21.440057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398bd3-4d76-4c64-8ef7-26172755c287 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:21.440327 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398bd3-4d76-4c64-8ef7-26172755c287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:21.441052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca398bd3-4d76-4c64-8ef7-26172755c287 None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71de6ef4ed504cfe8289c8ec519405bc) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:21.441359 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca398bd3-4d76-4c64-8ef7-26172755c287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:21.442780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca398bd3-4d76-4c64-8ef7-26172755c287 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:21.448314 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 632/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:50:21 2022] GET /identity/v3/role_assignments?user.id=71de6ef4ed504cfe8289c8ec519405bc&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:23.351560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd1fe-d93d-419f-9cc1-aeda49a7f16f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:23.352134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd1fe-d93d-419f-9cc1-aeda49a7f16f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:23.352134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd1fe-d93d-419f-9cc1-aeda49a7f16f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:23.353481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 629/1261] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:23.358575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25cdb3-e90d-416f-852d-ff3b63bafd31 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:23.359385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25cdb3-e90d-416f-852d-ff3b63bafd31 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:23.359385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25cdb3-e90d-416f-852d-ff3b63bafd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:23.377271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-ab25cdb3-e90d-416f-852d-ff3b63bafd31 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:23.378465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-ab25cdb3-e90d-416f-852d-ff3b63bafd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:23.448467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 633/1262] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:23.725816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cd1fe-d93d-419f-9cc1-aeda49a7f16f None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:23.737408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:23.825857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cd1fe-d93d-419f-9cc1-aeda49a7f16f None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:23.861860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:23.862492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:23.862769 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:23.863042 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:23.873211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:23.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:23.879465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:23.880479 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 630/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:23.885648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25cdb3-e90d-416f-852d-ff3b63bafd31 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:23.904016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:23.986342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25cdb3-e90d-416f-852d-ff3b63bafd31 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:24.020154 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:24.020756 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:24.021051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:24.021323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:24.021985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:24.024491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:24.024491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:24.032684 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 634/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:24.038542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:24.106782 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:24.139738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8b3d-c742-4a01-abba-a8b1c98b1d95 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:24.173472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:24.174100 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:24.174376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:24.174648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:24.185016 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:24.186446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:24.200251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:24.201374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:24.202293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:24.202293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:24.202293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:24.202293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 631/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:24.208285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:24.289570 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:24.308650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6c89b-0f6a-41bc-ac2a-6072e7381fdb None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:24.342370 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:24.342970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:24.343607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:24.344025 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:24.344669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:24.344970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:24.346372 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:24.358327 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 635/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:24.364661 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:24.467113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d0d5-80e4-4a3c-aee2-8fd6fdc60ca0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:24.489625 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:24.505018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:24.505694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:24.505974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:24.506315 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:24.515019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:24.517051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:50:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:24.533253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:24.534455 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 632/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:24.539542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:24.646696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85f2e-cefd-4fc7-9fd2-543e37ea5b73 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:24.684071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:24.684688 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:24.685049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:24.685230 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:24.685976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:24.686277 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:24.687816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:24.697916 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:24.708454 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 636/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Sun Aug 28 00:50:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:24.714277 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:24.821653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f11b74-593e-4b6f-999c-88a522274098 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:24.858074 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:24.858733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:24.859035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:24.859394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:24.870080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:24.871689 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:24.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:24.888435 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:24.889477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:24.889477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:24.889477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:24.889477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 633/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:24.894968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:25.001242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda28ba-50c0-4315-b1dc-a2a192f870b4 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:25.037416 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:25.038025 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:25.038304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:25.038578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:25.039257 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:25.039562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:25.040935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:25.052981 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 637/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:25.058860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:25.096642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:25.168005 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2208a7-ca4a-470c-bf29-5296607b4292 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:25.207583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:25.208245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:25.208525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:25.208797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:25.217024 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:25.217440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:50:25.230061 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:25.231711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:25.233334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 634/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:25.237357 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:25.298702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:25.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d83310-f977-49ed-84f1-4fdbcbf9ff9b None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:25.380301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0617b6-5917-4422-89fa-a3d991d09741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:25.380919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0617b6-5917-4422-89fa-a3d991d09741 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:25.381202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0617b6-5917-4422-89fa-a3d991d09741 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:25.381466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0617b6-5917-4422-89fa-a3d991d09741 None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:25.382170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0617b6-5917-4422-89fa-a3d991d09741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:25.382472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0617b6-5917-4422-89fa-a3d991d09741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:25.383944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0617b6-5917-4422-89fa-a3d991d09741 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:25.397223 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 638/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:25.403342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:25.508984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:25.518267 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6ea9c-eae7-4247-ae18-3044ff20f496 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:25.551474 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c015105-6a57-4a79-9ece-b5bbce4ec9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:25.552048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c015105-6a57-4a79-9ece-b5bbce4ec9a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:25.552322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c015105-6a57-4a79-9ece-b5bbce4ec9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:25.552590 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c015105-6a57-4a79-9ece-b5bbce4ec9a3 None admin] PATH_INFO: `/v3/projects/83e2a814cb694514a265b38274222c25/users/71de6ef4ed504cfe8289c8ec519405bc/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:25.554527 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c015105-6a57-4a79-9ece-b5bbce4ec9a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=83e2a814cb694514a265b38274222c25, user_id=71de6ef4ed504cfe8289c8ec519405bc, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:25.555980 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c015105-6a57-4a79-9ece-b5bbce4ec9a3 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:25.745656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 635/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Sun Aug 28 00:50:25 2022] PUT /identity/v3/projects/83e2a814cb694514a265b38274222c25/users/71de6ef4ed504cfe8289c8ec519405bc/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:50:27.674095 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046048e3-56fa-43cc-afe1-abeb10fc1454 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:27.674628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046048e3-56fa-43cc-afe1-abeb10fc1454 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:27.674628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046048e3-56fa-43cc-afe1-abeb10fc1454 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:27.676062 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 639/1274] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:27.681884 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160e15a-46ca-425c-aed3-6e666c1cef97 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:27.682345 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160e15a-46ca-425c-aed3-6e666c1cef97 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:27.682451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160e15a-46ca-425c-aed3-6e666c1cef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:27.701071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-1160e15a-46ca-425c-aed3-6e666c1cef97 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:27.702266 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-1160e15a-46ca-425c-aed3-6e666c1cef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:27.773317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 636/1275] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:50:28.042474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046048e3-56fa-43cc-afe1-abeb10fc1454 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:28.158783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046048e3-56fa-43cc-afe1-abeb10fc1454 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:28.180139 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:28.198816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:28.199485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:28.199763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:28.200051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:28.211735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:28.216689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:28.217867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:28.218835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 640/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Sun Aug 28 00:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:28.225132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160e15a-46ca-425c-aed3-6e666c1cef97 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:28.332528 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:28.350696 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160e15a-46ca-425c-aed3-6e666c1cef97 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:28.384518 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:28.385128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:28.385407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:28.385730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:28.386430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:28.386727 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:28.388160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:28.396637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 637/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Sun Aug 28 00:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:28.407583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:28.509738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28309c79-18c6-4b27-a95f-d4e167f86ccf None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:28.545639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:28.546474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:28.546666 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:28.546903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:28.561729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:28.563346 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:28.577594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:28.579365 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:28.580363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:28.580363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:28.580363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:28.580363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 641/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:28.585603 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:28.688903 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edd078-3e53-44e8-89a7-6da21e76705e None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:28.724767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:28.725371 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:28.725643 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:28.725911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:28.726538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:28.726837 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:28.728285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:28.740548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 638/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:28.746542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:28.778302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:28.849651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe704b-0256-4f21-b581-7daf036272cc None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:28.886657 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:28.887406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:28.887784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:28.888098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:28.896588 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:28.898008 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:50:28.910094 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:28.911823 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:28.913829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 642/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:28.918439 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:28.925118 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:29.026392 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445147-c172-4fa2-8441-1f8e6201dec0 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:29.068606 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:29.069651 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:29.070156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:29.070651 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:29.072079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:29.072646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:29.075423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:29.107286 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 639/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Sun Aug 28 00:50:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:29.113440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:29.209931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:29.220039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddaf7-a3bd-4a49-a94e-e0648f3a554a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:29.254388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:29.255052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:29.255343 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:29.255653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:29.325735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:29.327222 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:29.426367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:29.438913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 643/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Sun Aug 28 00:50:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:50:29.445131 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:29.514884 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:29.554229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583cca2-498f-49e8-be07-0d6785c84db9 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:29.588193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:29.588852 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:29.589124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:29.589390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:29.599121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:29.600692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:29.615735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:29.616706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:29.617669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:29.617669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:29.617669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:29.617669 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 640/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:29.622784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:29.727387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2dde-9bbb-48d4-9d29-8f5be474ff9a None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:29.761996 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:29.762607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:29.762905 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:29.763210 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:29.763854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:29.766118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:29.766118 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:29.777115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 644/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:29.783642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:29.887386 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3296587-9bfb-48e4-bd46-90f434dd9c7a None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:29.901104 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:29.921472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:29.922112 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:29.923015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:29.923321 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:29.929897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:29.931346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:50:29.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:29.955730 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: ERROR keystone.server.flask.application Aug 28 00:50:29.956948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 641/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Sun Aug 28 00:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:29.957606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:30.004028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:30.055384 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b43ea5-e742-40ba-955f-1b521bf6699c None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:30.090808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e83f4-cfb3-46ac-bb53-7087c595bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:30.091441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e83f4-cfb3-46ac-bb53-7087c595bffc None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:30.091720 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e83f4-cfb3-46ac-bb53-7087c595bffc None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:30.091990 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e83f4-cfb3-46ac-bb53-7087c595bffc None admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:30.092680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e83f4-cfb3-46ac-bb53-7087c595bffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:30.092987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e83f4-cfb3-46ac-bb53-7087c595bffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:30.095220 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e83f4-cfb3-46ac-bb53-7087c595bffc None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:30.107640 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 645/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Sun Aug 28 00:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:30.113968 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:30.217496 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592d4e-8a79-454b-9d79-c2d3a0a89f30 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:30.251068 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f448-e0a8-4358-93dc-f8f58f2a792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:30.251687 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f448-e0a8-4358-93dc-f8f58f2a792b None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:30.251960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f448-e0a8-4358-93dc-f8f58f2a792b None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:30.252226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f448-e0a8-4358-93dc-f8f58f2a792b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:30.252940 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f448-e0a8-4358-93dc-f8f58f2a792b None admin] RBAC: Adding query filter params (role.id=82d5022e454c445f8cefd903b8eef5b0, scope.project.id=83e2a814cb694514a265b38274222c25, user.id=71de6ef4ed504cfe8289c8ec519405bc) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:30.253291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f448-e0a8-4358-93dc-f8f58f2a792b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:30.254813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f448-e0a8-4358-93dc-f8f58f2a792b None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:30.260584 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 642/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Sun Aug 28 00:50:30 2022] GET /identity/v3/role_assignments?user.id=71de6ef4ed504cfe8289c8ec519405bc&scope.project.id=83e2a814cb694514a265b38274222c25&role.id=82d5022e454c445f8cefd903b8eef5b0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:32.248292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802b01-3bcd-41a5-8ce7-d3e8d7c971a4 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:32.248856 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802b01-3bcd-41a5-8ce7-d3e8d7c971a4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:32.248856 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802b01-3bcd-41a5-8ce7-d3e8d7c971a4 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:32.250710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 646/1288] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:32.256465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9176e-f513-481b-a869-edbb2c06acb8 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:32.256872 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9176e-f513-481b-a869-edbb2c06acb8 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:32.257015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9176e-f513-481b-a869-edbb2c06acb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:32.275960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d5b9176e-f513-481b-a869-edbb2c06acb8 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:32.277161 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d5b9176e-f513-481b-a869-edbb2c06acb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:32.308074 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:32.348305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 643/1289] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:32.617207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5802b01-3bcd-41a5-8ce7-d3e8d7c971a4 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:32.722808 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5802b01-3bcd-41a5-8ce7-d3e8d7c971a4 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:32.733427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:32.756810 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:32.757589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:32.757873 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:32.758152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:32.758738 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:32.760166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:32.769743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:32.771058 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:32.772191 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 647/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:50:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:32.777063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9176e-f513-481b-a869-edbb2c06acb8 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:32.878656 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9176e-f513-481b-a869-edbb2c06acb8 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:32.913156 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b7d50-b94f-40fc-be9e-51230d9c4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:32.913772 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b7d50-b94f-40fc-be9e-51230d9c4060 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:32.914171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b7d50-b94f-40fc-be9e-51230d9c4060 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:32.914450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b7d50-b94f-40fc-be9e-51230d9c4060 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:32.915084 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b7d50-b94f-40fc-be9e-51230d9c4060 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:32.915421 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b7d50-b94f-40fc-be9e-51230d9c4060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:32.916797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b7d50-b94f-40fc-be9e-51230d9c4060 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:32.921745 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 644/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Sun Aug 28 00:50:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:32.927805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:33.036039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8f417-879a-4104-84e3-7e1ea454bcb7 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:33.069897 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfb7b9-a040-4cf7-845e-6a3761ed1c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:33.070507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb7b9-a040-4cf7-845e-6a3761ed1c7b None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:33.070778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb7b9-a040-4cf7-845e-6a3761ed1c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:33.071121 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb7b9-a040-4cf7-845e-6a3761ed1c7b None admin] PATH_INFO: `/v3/services` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:33.071744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfb7b9-a040-4cf7-845e-6a3761ed1c7b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:33.072079 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfb7b9-a040-4cf7-845e-6a3761ed1c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:33.073436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfb7b9-a040-4cf7-845e-6a3761ed1c7b None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:33.078037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 648/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Sun Aug 28 00:50:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:35.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3982c76-3f1a-4447-8495-f1fea0c7a1c4 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:35.008436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3982c76-3f1a-4447-8495-f1fea0c7a1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:35.008436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3982c76-3f1a-4447-8495-f1fea0c7a1c4 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:35.009799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 645/1293] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:35.015263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2916b-b73c-4846-8cc0-e4fbbb93d025 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:35.015899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2916b-b73c-4846-8cc0-e4fbbb93d025 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:35.016230 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2916b-b73c-4846-8cc0-e4fbbb93d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:35.034796 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-72f2916b-b73c-4846-8cc0-e4fbbb93d025 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:35.037975 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-72f2916b-b73c-4846-8cc0-e4fbbb93d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:35.065770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:35.103418 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 649/1294] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:35.378204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3982c76-3f1a-4447-8495-f1fea0c7a1c4 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:35.411169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:35.483137 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3982c76-3f1a-4447-8495-f1fea0c7a1c4 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:35.520401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1d8a5-ee31-41c4-8d47-64b71a1697c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:35.521017 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1d8a5-ee31-41c4-8d47-64b71a1697c2 None admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:35.521291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1d8a5-ee31-41c4-8d47-64b71a1697c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:35.521561 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1d8a5-ee31-41c4-8d47-64b71a1697c2 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:35.522240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1d8a5-ee31-41c4-8d47-64b71a1697c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:35.523677 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1d8a5-ee31-41c4-8d47-64b71a1697c2 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:35.600543 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 646/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Sun Aug 28 00:50:35 2022] POST /identity/v3/services => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:50:37.566112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae8de6-b1d5-4fae-8b43-4c48f0519627 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:37.566671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae8de6-b1d5-4fae-8b43-4c48f0519627 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:37.566671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae8de6-b1d5-4fae-8b43-4c48f0519627 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:37.568075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 650/1296] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:37.573713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143fa1a-d574-4d5c-9822-22dd996d9a3c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:37.574160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143fa1a-d574-4d5c-9822-22dd996d9a3c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:37.574305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143fa1a-d574-4d5c-9822-22dd996d9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:37.592445 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d143fa1a-d574-4d5c-9822-22dd996d9a3c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:37.593637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d143fa1a-d574-4d5c-9822-22dd996d9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:37.667990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 647/1297] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:37.946585 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae8de6-b1d5-4fae-8b43-4c48f0519627 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:38.049128 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae8de6-b1d5-4fae-8b43-4c48f0519627 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:38.083534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5870488-e294-4318-9baf-244104281843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:38.084158 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5870488-e294-4318-9baf-244104281843 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:38.084436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5870488-e294-4318-9baf-244104281843 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:38.084706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5870488-e294-4318-9baf-244104281843 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:38.085286 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5870488-e294-4318-9baf-244104281843 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:38.086668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5870488-e294-4318-9baf-244104281843 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-f5870488-e294-4318-9baf-244104281843 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:38.096129 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:38.105087 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:38.106065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 651/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:50:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:38.106992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143fa1a-d574-4d5c-9822-22dd996d9a3c None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:38.121860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:38.200607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143fa1a-d574-4d5c-9822-22dd996d9a3c None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:38.234737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85380157-29d6-4135-87be-c93bde403465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:38.235440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380157-29d6-4135-87be-c93bde403465 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:38.235724 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380157-29d6-4135-87be-c93bde403465 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:38.235994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380157-29d6-4135-87be-c93bde403465 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:38.236618 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380157-29d6-4135-87be-c93bde403465 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:38.236919 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380157-29d6-4135-87be-c93bde403465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:38.238281 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380157-29d6-4135-87be-c93bde403465 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:38.244612 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 648/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Sun Aug 28 00:50:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:38.249422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5870488-e294-4318-9baf-244104281843 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:38.280792 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:38.349953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5870488-e294-4318-9baf-244104281843 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:38.383011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b28e27-5637-4a06-b9a8-9a34ba319728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:38.383651 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b28e27-5637-4a06-b9a8-9a34ba319728 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:38.383927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b28e27-5637-4a06-b9a8-9a34ba319728 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:38.384199 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b28e27-5637-4a06-b9a8-9a34ba319728 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:38.384898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b28e27-5637-4a06-b9a8-9a34ba319728 None admin] RBAC: Adding query filter params (interface=public, service_id=c03fdfd8774b4ae2bc3e25fae07d4499, region_id=RegionOne) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:38.385201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b28e27-5637-4a06-b9a8-9a34ba319728 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:38.386554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b28e27-5637-4a06-b9a8-9a34ba319728 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:38.392390 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 652/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Sun Aug 28 00:50:38 2022] GET /identity/v3/endpoints?service_id=c03fdfd8774b4ae2bc3e25fae07d4499&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:38.398161 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85380157-29d6-4135-87be-c93bde403465 None admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:38.483009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:38.501799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85380157-29d6-4135-87be-c93bde403465 None admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:38.536926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671728f-667e-4531-a67a-bf8af275dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:38.537534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671728f-667e-4531-a67a-bf8af275dc72 None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:38.537814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671728f-667e-4531-a67a-bf8af275dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:38.538089 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671728f-667e-4531-a67a-bf8af275dc72 None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:38.538688 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671728f-667e-4531-a67a-bf8af275dc72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:38.540100 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671728f-667e-4531-a67a-bf8af275dc72 None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:38.547218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 649/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Sun Aug 28 00:50:38 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:50:40.522791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4961-b60f-4a03-8d5f-c23264c6332a None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:40.523381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4961-b60f-4a03-8d5f-c23264c6332a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:40.523381 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4961-b60f-4a03-8d5f-c23264c6332a None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:40.524704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 653/1302] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:40.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7e72-0500-4de3-a8b3-a50646921914 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:40.530569 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7e72-0500-4de3-a8b3-a50646921914 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:40.533328 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7e72-0500-4de3-a8b3-a50646921914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:40.549924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c36f7e72-0500-4de3-a8b3-a50646921914 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:40.551138 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c36f7e72-0500-4de3-a8b3-a50646921914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:40.620389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 650/1303] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:50:40.908098 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4961-b60f-4a03-8d5f-c23264c6332a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:41.005317 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:41.012267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4961-b60f-4a03-8d5f-c23264c6332a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:41.046980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:41.047634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:41.047907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:41.048174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:41.048758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:41.050107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:41.059144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:41.065059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: ERROR keystone.server.flask.application Aug 28 00:50:41.066187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 654/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Sun Aug 28 00:50:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:41.067710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7e72-0500-4de3-a8b3-a50646921914 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:41.143603 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:41.165492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7e72-0500-4de3-a8b3-a50646921914 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:41.199004 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eb36e-c35d-4ea6-9c38-2f2d042844fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:41.199621 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb36e-c35d-4ea6-9c38-2f2d042844fd None admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:41.199897 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb36e-c35d-4ea6-9c38-2f2d042844fd None admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:41.200162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb36e-c35d-4ea6-9c38-2f2d042844fd None admin] PATH_INFO: `/v3/services` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:41.200794 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb36e-c35d-4ea6-9c38-2f2d042844fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:41.201081 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb36e-c35d-4ea6-9c38-2f2d042844fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:41.202429 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb36e-c35d-4ea6-9c38-2f2d042844fd None admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:41.208468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 651/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Sun Aug 28 00:50:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:41.214391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:41.316710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65eb9-a582-43e5-8f4b-8af930925274 None admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:41.351075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d55648-9a92-4d8d-80fb-6a67fa21bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:41.351710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d55648-9a92-4d8d-80fb-6a67fa21bf62 None admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:41.351982 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d55648-9a92-4d8d-80fb-6a67fa21bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:41.352251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d55648-9a92-4d8d-80fb-6a67fa21bf62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:41.352906 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d55648-9a92-4d8d-80fb-6a67fa21bf62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:41.354258 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d55648-9a92-4d8d-80fb-6a67fa21bf62 None admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:41.457050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 655/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 00:50:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:50:51.215748 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=30 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:51.451380 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:10.388731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9028a-8075-4b96-beed-f035a2d4d9e3 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:10.390296 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9028a-8075-4b96-beed-f035a2d4d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:10.390794 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9028a-8075-4b96-beed-f035a2d4d9e3 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:10.400106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f1a5-ec53-44fb-b1a8-b09545f75768 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:10.404391 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f1a5-ec53-44fb-b1a8-b09545f75768 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:10.406378 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f1a5-ec53-44fb-b1a8-b09545f75768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:10.412066 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 652/1307] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:10 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:10.504787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-0285f1a5-ec53-44fb-b1a8-b09545f75768 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:10.506036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-0285f1a5-ec53-44fb-b1a8-b09545f75768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:10.625243 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 656/1308] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:10.932911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f04d-4693-4f68-b846-fd42d186588d None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:10.933570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f04d-4693-4f68-b846-fd42d186588d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:10.934128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f04d-4693-4f68-b846-fd42d186588d None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:10.937878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 653/1309] 10.222.0.58 () {54 vars in 965 bytes} [Sun Aug 28 00:57:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:10.944156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9017cf-d0d8-4533-ad2e-6ebf1beb17fd None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:10.944447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9017cf-d0d8-4533-ad2e-6ebf1beb17fd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:10.944730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9017cf-d0d8-4533-ad2e-6ebf1beb17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:11.029294 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-4f9017cf-d0d8-4533-ad2e-6ebf1beb17fd None None] MFA Rules not processed for user `487a390503154187ab842e40b2a2fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:11.030698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-4f9017cf-d0d8-4533-ad2e-6ebf1beb17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:11.053893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:11.114934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 657/1310] 10.222.0.58 () {58 vars in 1062 bytes} [Sun Aug 28 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:11.124486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f04d-4693-4f68-b846-fd42d186588d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:11.126600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5328f04d-4693-4f68-b846-fd42d186588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:11.245095 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f04d-4693-4f68-b846-fd42d186588d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:11.331215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf0a46-477c-40bb-9412-0abd258b0e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:11.331829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf0a46-477c-40bb-9412-0abd258b0e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:11.332101 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf0a46-477c-40bb-9412-0abd258b0e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:11.332364 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf0a46-477c-40bb-9412-0abd258b0e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:11.334205 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3bcf0a46-477c-40bb-9412-0abd258b0e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:11.395963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:11.459583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf0a46-477c-40bb-9412-0abd258b0e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:11.461030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf0a46-477c-40bb-9412-0abd258b0e8c service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:11.480916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 654/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:13.708936 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5c961-f23b-41cd-a8ad-278854b7e911 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:13.709478 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5c961-f23b-41cd-a8ad-278854b7e911 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:13.709478 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5c961-f23b-41cd-a8ad-278854b7e911 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:13.710862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 658/1312] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:13.716766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef1ca3-fab7-4c09-b3b0-83101a70cd9c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:13.717432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef1ca3-fab7-4c09-b3b0-83101a70cd9c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:13.717432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef1ca3-fab7-4c09-b3b0-83101a70cd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:13.801120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c7ef1ca3-fab7-4c09-b3b0-83101a70cd9c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:13.802376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c7ef1ca3-fab7-4c09-b3b0-83101a70cd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:13.915605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 655/1313] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:14.199422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5c961-f23b-41cd-a8ad-278854b7e911 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:14.200969 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-22b5c961-f23b-41cd-a8ad-278854b7e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:14.306978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5c961-f23b-41cd-a8ad-278854b7e911 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:14.377363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:14.379815 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76033bc5-d585-467e-981a-a1fab66a9b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:14.380418 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033bc5-d585-467e-981a-a1fab66a9b77 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:14.380694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033bc5-d585-467e-981a-a1fab66a9b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:14.380966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033bc5-d585-467e-981a-a1fab66a9b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:14.382571 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-76033bc5-d585-467e-981a-a1fab66a9b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:14.490453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76033bc5-d585-467e-981a-a1fab66a9b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:14.491915 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76033bc5-d585-467e-981a-a1fab66a9b77 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:14.512276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 659/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:17.061719 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4c80-894e-44a7-9cf2-1b7ff04733e6 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:17.062226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4c80-894e-44a7-9cf2-1b7ff04733e6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:17.062226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4c80-894e-44a7-9cf2-1b7ff04733e6 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:17.063564 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 656/1315] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:17.069206 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ac19-968d-46db-b03a-0be71a57154b None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:17.069628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ac19-968d-46db-b03a-0be71a57154b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:17.069724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ac19-968d-46db-b03a-0be71a57154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:17.134216 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-12e9ac19-968d-46db-b03a-0be71a57154b None None] MFA Rules not processed for user `b16bbf73d702424c9a4d703e49d68880`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:17.135458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-12e9ac19-968d-46db-b03a-0be71a57154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:17.186155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:17.228706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 660/1316] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:17.527399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485523-3af5-431f-b617-f529e8ba3756 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:17.527680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485523-3af5-431f-b617-f529e8ba3756 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:17.527951 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485523-3af5-431f-b617-f529e8ba3756 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:17.529792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 657/1317] 10.222.0.58 () {54 vars in 965 bytes} [Sun Aug 28 00:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:17.535708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbe1d5-5f0b-4d92-80a4-cbdb94fd5fa7 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:17.536072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbe1d5-5f0b-4d92-80a4-cbdb94fd5fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:17.536355 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbe1d5-5f0b-4d92-80a4-cbdb94fd5fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:17.612950 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-72fbe1d5-5f0b-4d92-80a4-cbdb94fd5fa7 None None] MFA Rules not processed for user `487a390503154187ab842e40b2a2fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:17.614157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-72fbe1d5-5f0b-4d92-80a4-cbdb94fd5fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:17.692393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 661/1318] 10.222.0.58 () {58 vars in 1062 bytes} [Sun Aug 28 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:17.701824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485523-3af5-431f-b617-f529e8ba3756 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:17.703372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-76485523-3af5-431f-b617-f529e8ba3756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:17.713228 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:17.810294 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485523-3af5-431f-b617-f529e8ba3756 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:17.884319 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381b1f0-83d0-4244-b389-7b2448e312e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:17.884921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b1f0-83d0-4244-b389-7b2448e312e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:17.885246 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b1f0-83d0-4244-b389-7b2448e312e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:17.885519 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b1f0-83d0-4244-b389-7b2448e312e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:17.887134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-1381b1f0-83d0-4244-b389-7b2448e312e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:17.949079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:17.996049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381b1f0-83d0-4244-b389-7b2448e312e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:17.997486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381b1f0-83d0-4244-b389-7b2448e312e9 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:18.016589 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 658/1319] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:21.284261 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe57a-e57c-4673-af4b-1638dcd94270 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:21.284852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe57a-e57c-4673-af4b-1638dcd94270 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:21.284852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe57a-e57c-4673-af4b-1638dcd94270 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:21.286131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 662/1320] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:21.291482 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a9e9a-59f9-4330-a421-4aa8bc098a3f None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:21.291904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a9e9a-59f9-4330-a421-4aa8bc098a3f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:21.292007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a9e9a-59f9-4330-a421-4aa8bc098a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:21.357948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-907a9e9a-59f9-4330-a421-4aa8bc098a3f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:21.359203 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-907a9e9a-59f9-4330-a421-4aa8bc098a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:21.457557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 659/1321] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:21.745174 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe57a-e57c-4673-af4b-1638dcd94270 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:21.746700 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-bbafe57a-e57c-4673-af4b-1638dcd94270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:21.798194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:21.859989 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe57a-e57c-4673-af4b-1638dcd94270 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:21.932809 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7ec1-8cb3-4aa5-94d1-41fe037e1869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:21.933334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7ec1-8cb3-4aa5-94d1-41fe037e1869 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:21.933607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7ec1-8cb3-4aa5-94d1-41fe037e1869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:21.933877 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7ec1-8cb3-4aa5-94d1-41fe037e1869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:21.935560 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-0d2c7ec1-8cb3-4aa5-94d1-41fe037e1869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:22.032141 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:22.045276 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c7ec1-8cb3-4aa5-94d1-41fe037e1869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:22.046714 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c7ec1-8cb3-4aa5-94d1-41fe037e1869 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:22.064898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 663/1322] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:25.068943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558644d6-b79e-4891-aadd-3ea37715991e None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.068943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558644d6-b79e-4891-aadd-3ea37715991e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.068943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558644d6-b79e-4891-aadd-3ea37715991e None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.069942 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 660/1323] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:25.075209 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee852-ced6-49fb-89cd-e06cbc856677 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.075613 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee852-ced6-49fb-89cd-e06cbc856677 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.075748 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ee852-ced6-49fb-89cd-e06cbc856677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.144167 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-431ee852-ced6-49fb-89cd-e06cbc856677 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:25.145377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-431ee852-ced6-49fb-89cd-e06cbc856677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:25.246493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 664/1324] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:25.534263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558644d6-b79e-4891-aadd-3ea37715991e None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.535929 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-558644d6-b79e-4891-aadd-3ea37715991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:25.556075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:25.641408 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558644d6-b79e-4891-aadd-3ea37715991e None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.718855 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2c5bb-0a24-483c-984b-2797d5ee2a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.719492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c5bb-0a24-483c-984b-2797d5ee2a2a service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.719766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c5bb-0a24-483c-984b-2797d5ee2a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.720033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2c5bb-0a24-483c-984b-2797d5ee2a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.721637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6ee2c5bb-0a24-483c-984b-2797d5ee2a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:25.792511 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:25.831341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2c5bb-0a24-483c-984b-2797d5ee2a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.832788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2c5bb-0a24-483c-984b-2797d5ee2a2a service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.851945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 661/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:27.834599 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a762-4e62-4005-b099-2dfdf28aa810 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.835131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a762-4e62-4005-b099-2dfdf28aa810 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.835131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a762-4e62-4005-b099-2dfdf28aa810 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.836389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 665/1326] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:27.842255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f4ec-7229-472e-978c-cfd1e3b6141c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.842716 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f4ec-7229-472e-978c-cfd1e3b6141c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.842923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f4ec-7229-472e-978c-cfd1e3b6141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.913394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-be18f4ec-7229-472e-978c-cfd1e3b6141c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:27.914607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-be18f4ec-7229-472e-978c-cfd1e3b6141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:28.018720 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 662/1327] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:28.305220 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a762-4e62-4005-b099-2dfdf28aa810 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.306834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2637a762-4e62-4005-b099-2dfdf28aa810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:28.370235 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:28.416526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a762-4e62-4005-b099-2dfdf28aa810 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.499856 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd44a48-0d0c-407a-9b32-659381f3413a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.500464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd44a48-0d0c-407a-9b32-659381f3413a service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.500737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd44a48-0d0c-407a-9b32-659381f3413a service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.501005 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd44a48-0d0c-407a-9b32-659381f3413a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.502787 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2cd44a48-0d0c-407a-9b32-659381f3413a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:28.613207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:28.615641 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd44a48-0d0c-407a-9b32-659381f3413a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.617199 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd44a48-0d0c-407a-9b32-659381f3413a service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.637029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 666/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:30.654809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf2d4-302a-43a8-b92f-06b246a1bfa0 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.655465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf2d4-302a-43a8-b92f-06b246a1bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.655465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf2d4-302a-43a8-b92f-06b246a1bfa0 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.656853 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 663/1329] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:30.662874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c1917-3a6f-4e8d-982c-d812a9b64c02 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.663473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c1917-3a6f-4e8d-982c-d812a9b64c02 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.663565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c1917-3a6f-4e8d-982c-d812a9b64c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.731202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b18c1917-3a6f-4e8d-982c-d812a9b64c02 None None] MFA Rules not processed for user `b16bbf73d702424c9a4d703e49d68880`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:30.733036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b18c1917-3a6f-4e8d-982c-d812a9b64c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:30.835493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 667/1330] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:31.131019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf2d4-302a-43a8-b92f-06b246a1bfa0 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:31.132593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-421cf2d4-302a-43a8-b92f-06b246a1bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:31.166107 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:31.244235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf2d4-302a-43a8-b92f-06b246a1bfa0 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:31.318806 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fe6e0-2adb-4bb8-bea2-3af17740c02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:31.319395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fe6e0-2adb-4bb8-bea2-3af17740c02c service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:31.319674 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fe6e0-2adb-4bb8-bea2-3af17740c02c service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:31.319944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fe6e0-2adb-4bb8-bea2-3af17740c02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:31.321545 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-369fe6e0-2adb-4bb8-bea2-3af17740c02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:31.401358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:31.434252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fe6e0-2adb-4bb8-bea2-3af17740c02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:31.435657 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fe6e0-2adb-4bb8-bea2-3af17740c02c service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:31.455021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 664/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:33.902824 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e087a-632f-407d-a3a9-40b11e53949f None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:33.903374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e087a-632f-407d-a3a9-40b11e53949f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:33.903374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e087a-632f-407d-a3a9-40b11e53949f None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:33.905698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 668/1332] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:33.910913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690714c4-0c3a-4fd1-80d0-e25a096e3c05 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:33.911313 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690714c4-0c3a-4fd1-80d0-e25a096e3c05 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:33.911524 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690714c4-0c3a-4fd1-80d0-e25a096e3c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:33.980150 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-690714c4-0c3a-4fd1-80d0-e25a096e3c05 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:33.981266 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-690714c4-0c3a-4fd1-80d0-e25a096e3c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:34.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 665/1333] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:34.364946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e087a-632f-407d-a3a9-40b11e53949f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:34.366475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d15e087a-632f-407d-a3a9-40b11e53949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:34.435717 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:34.471183 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e087a-632f-407d-a3a9-40b11e53949f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:34.543445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f23a-f5dd-4e73-b5d2-aa3daace55c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:34.543971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f23a-f5dd-4e73-b5d2-aa3daace55c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:34.544250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f23a-f5dd-4e73-b5d2-aa3daace55c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:34.544701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f23a-f5dd-4e73-b5d2-aa3daace55c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:34.546307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-12d3f23a-f5dd-4e73-b5d2-aa3daace55c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:34.653489 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3f23a-f5dd-4e73-b5d2-aa3daace55c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:34.654964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3f23a-f5dd-4e73-b5d2-aa3daace55c6 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:34.665048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:34.673866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 669/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:57:36.637574 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc25589-6816-4ddf-a19c-c6d403d175af None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:36.638665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc25589-6816-4ddf-a19c-c6d403d175af None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:36.638665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc25589-6816-4ddf-a19c-c6d403d175af None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:36.640155 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 666/1335] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:36.645350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd95b-836b-4760-9be0-042a036de658 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:36.645793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd95b-836b-4760-9be0-042a036de658 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:36.645889 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd95b-836b-4760-9be0-042a036de658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:36.714972 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c87dd95b-836b-4760-9be0-042a036de658 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:36.716770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c87dd95b-836b-4760-9be0-042a036de658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:36.811842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 670/1336] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:37.093977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc25589-6816-4ddf-a19c-c6d403d175af None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:37.095541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3fc25589-6816-4ddf-a19c-c6d403d175af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:37.135949 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:37.201731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc25589-6816-4ddf-a19c-c6d403d175af None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:37.274261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384882-3419-4ac0-a829-abe696b76b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:37.274860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384882-3419-4ac0-a829-abe696b76b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:37.275160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384882-3419-4ac0-a829-abe696b76b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:37.275434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384882-3419-4ac0-a829-abe696b76b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:37.277052 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e1384882-3419-4ac0-a829-abe696b76b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:37.360692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:37.388654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384882-3419-4ac0-a829-abe696b76b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:37.390079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384882-3419-4ac0-a829-abe696b76b26 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:37.409499 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 667/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:40.091973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bae1-ad35-4cbe-b17a-0df27b19a06d None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:40.092505 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bae1-ad35-4cbe-b17a-0df27b19a06d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:40.092708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bae1-ad35-4cbe-b17a-0df27b19a06d None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:40.094046 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 671/1338] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:40.099215 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf921c-9234-4ce0-b0db-407e53b45935 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:40.099650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf921c-9234-4ce0-b0db-407e53b45935 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:40.099755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf921c-9234-4ce0-b0db-407e53b45935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:40.167359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-5abf921c-9234-4ce0-b0db-407e53b45935 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:40.168558 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5abf921c-9234-4ce0-b0db-407e53b45935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:40.265075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 668/1339] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:40.549085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bae1-ad35-4cbe-b17a-0df27b19a06d None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:40.550609 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-fbf9bae1-ad35-4cbe-b17a-0df27b19a06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:40.625423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:40.653113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bae1-ad35-4cbe-b17a-0df27b19a06d None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:40.728663 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8595742-c079-429d-839f-47142865aa4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:40.729263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8595742-c079-429d-839f-47142865aa4e service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:40.729535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8595742-c079-429d-839f-47142865aa4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:40.729801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8595742-c079-429d-839f-47142865aa4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:40.731398 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c8595742-c079-429d-839f-47142865aa4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:40.838819 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8595742-c079-429d-839f-47142865aa4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:40.840198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8595742-c079-429d-839f-47142865aa4e service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:40.857927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 672/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:44.981714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308b5d-fd73-4799-a79f-824a354165a9 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.982234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308b5d-fd73-4799-a79f-824a354165a9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.982234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308b5d-fd73-4799-a79f-824a354165a9 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.984343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 669/1341] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:44.989887 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464109eb-2e24-4e47-9097-489a2e5f3bc4 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.990342 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464109eb-2e24-4e47-9097-489a2e5f3bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.990438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464109eb-2e24-4e47-9097-489a2e5f3bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.995945 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:45.059802 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-464109eb-2e24-4e47-9097-489a2e5f3bc4 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:45.065716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-464109eb-2e24-4e47-9097-489a2e5f3bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.166112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 673/1342] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:45.456735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308b5d-fd73-4799-a79f-824a354165a9 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.458412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-88308b5d-fd73-4799-a79f-824a354165a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.513488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:45.571890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308b5d-fd73-4799-a79f-824a354165a9 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.648465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66208023-d94c-42f2-9245-bd7b97a9f1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.649090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208023-d94c-42f2-9245-bd7b97a9f1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.649575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208023-d94c-42f2-9245-bd7b97a9f1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.649906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208023-d94c-42f2-9245-bd7b97a9f1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.651510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-66208023-d94c-42f2-9245-bd7b97a9f1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.757569 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:45.774204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66208023-d94c-42f2-9245-bd7b97a9f1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.775693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66208023-d94c-42f2-9245-bd7b97a9f1a7 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.794078 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 670/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:48.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac5c15-8f50-443d-b844-83202e2dc433 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.766043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac5c15-8f50-443d-b844-83202e2dc433 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.766043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac5c15-8f50-443d-b844-83202e2dc433 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.767388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 674/1344] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:57:48.772853 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4030-d223-4a10-bcea-ce28aaec7d54 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.773355 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4030-d223-4a10-bcea-ce28aaec7d54 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.773454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4030-d223-4a10-bcea-ce28aaec7d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.841602 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-ff9d4030-d223-4a10-bcea-ce28aaec7d54 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:48.843379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ff9d4030-d223-4a10-bcea-ce28aaec7d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:48.945880 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 671/1345] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:49.236420 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac5c15-8f50-443d-b844-83202e2dc433 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:49.238061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-dcac5c15-8f50-443d-b844-83202e2dc433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:49.329677 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:49.348636 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac5c15-8f50-443d-b844-83202e2dc433 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:49.426947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178ee93-b469-4959-a30c-fb084165428f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:49.427582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ee93-b469-4959-a30c-fb084165428f service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:49.427853 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ee93-b469-4959-a30c-fb084165428f service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:49.428122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ee93-b469-4959-a30c-fb084165428f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:49.429696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c178ee93-b469-4959-a30c-fb084165428f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:49.545042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ee93-b469-4959-a30c-fb084165428f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:49.546492 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ee93-b469-4959-a30c-fb084165428f service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:49.565780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 675/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:53.710907 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1b77-d1b9-404b-8d97-018af8058a6f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:53.711510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1b77-d1b9-404b-8d97-018af8058a6f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:53.711510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1b77-d1b9-404b-8d97-018af8058a6f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:53.712878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 672/1347] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:53.719227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222056d-e857-4f44-9668-b5ea2c47b063 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:53.719719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222056d-e857-4f44-9668-b5ea2c47b063 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:53.719812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222056d-e857-4f44-9668-b5ea2c47b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:53.736300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:53.791990 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c222056d-e857-4f44-9668-b5ea2c47b063 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:53.793237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c222056d-e857-4f44-9668-b5ea2c47b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:53.906994 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 676/1348] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:54.191652 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1b77-d1b9-404b-8d97-018af8058a6f None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:54.193424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-f55e1b77-d1b9-404b-8d97-018af8058a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:54.265770 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:54.314034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1b77-d1b9-404b-8d97-018af8058a6f None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:54.390234 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3eae9-4836-435a-9fd0-000a7a38c9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:54.390831 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3eae9-4836-435a-9fd0-000a7a38c9db service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:54.391127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3eae9-4836-435a-9fd0-000a7a38c9db service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:54.391412 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3eae9-4836-435a-9fd0-000a7a38c9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:54.393035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e9f3eae9-4836-435a-9fd0-000a7a38c9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:54.503991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:54.507527 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3eae9-4836-435a-9fd0-000a7a38c9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:54.508964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3eae9-4836-435a-9fd0-000a7a38c9db service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:54.527600 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 673/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:59.484160 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a129d-ea54-448f-9015-b93a0ff00422 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:59.485164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a129d-ea54-448f-9015-b93a0ff00422 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:59.485673 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a129d-ea54-448f-9015-b93a0ff00422 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:59.489053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 677/1350] 10.222.0.58 () {54 vars in 921 bytes} [Sun Aug 28 00:57:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:59.494486 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414fe1d-2e54-4b9f-ba2d-58496b376e9e None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:59.495507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414fe1d-2e54-4b9f-ba2d-58496b376e9e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:59.496010 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414fe1d-2e54-4b9f-ba2d-58496b376e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:59.593847 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d414fe1d-2e54-4b9f-ba2d-58496b376e9e None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:59.595040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d414fe1d-2e54-4b9f-ba2d-58496b376e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:59.777498 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 674/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Sun Aug 28 00:57:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:03.896952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=59 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:04.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db4c0-3186-4a85-b334-958f74a11c83 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:04.134081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db4c0-3186-4a85-b334-958f74a11c83 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:04.134350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db4c0-3186-4a85-b334-958f74a11c83 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:04.136100 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 678/1352] 10.222.0.58 () {54 vars in 921 bytes} [Sun Aug 28 00:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:04.141261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100ca6-7909-44b5-8a38-0889e3c5d7b0 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:04.141712 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100ca6-7909-44b5-8a38-0889e3c5d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:04.141793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100ca6-7909-44b5-8a38-0889e3c5d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:04.198309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:04.227448 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-ea100ca6-7909-44b5-8a38-0889e3c5d7b0 None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:04.229438 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ea100ca6-7909-44b5-8a38-0889e3c5d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:04.353536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 675/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Sun Aug 28 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:05.577004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be86d-9a76-41a2-a699-1e69787680ad None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:05.577844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be86d-9a76-41a2-a699-1e69787680ad None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:05.577844 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be86d-9a76-41a2-a699-1e69787680ad None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:05.579143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 679/1354] 10.222.0.58 () {54 vars in 921 bytes} [Sun Aug 28 00:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:05.584337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f51ba-da38-4265-818d-0552426fe685 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:05.584789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f51ba-da38-4265-818d-0552426fe685 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:05.585014 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f51ba-da38-4265-818d-0552426fe685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:05.673797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-fd6f51ba-da38-4265-818d-0552426fe685 None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:05.675040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-fd6f51ba-da38-4265-818d-0552426fe685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:05.720565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:05.785434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 676/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Sun Aug 28 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:09.133056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28196dc-5f1f-4328-a008-210e740a317b None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:09.133882 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28196dc-5f1f-4328-a008-210e740a317b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:09.134377 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28196dc-5f1f-4328-a008-210e740a317b None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:09.135955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 680/1356] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:09.142079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeebd4b-3a67-473f-92df-240c1c1bb924 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:09.142079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeebd4b-3a67-473f-92df-240c1c1bb924 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:09.142556 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeebd4b-3a67-473f-92df-240c1c1bb924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:09.231603 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-baeebd4b-3a67-473f-92df-240c1c1bb924 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:09.232889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-baeebd4b-3a67-473f-92df-240c1c1bb924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:09.365127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 677/1357] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:09.671628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7954ed5-ec04-4e7a-b840-949509f77b66 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:09.672296 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7954ed5-ec04-4e7a-b840-949509f77b66 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:09.672581 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7954ed5-ec04-4e7a-b840-949509f77b66 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:09.674435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 681/1358] 10.222.0.58 () {54 vars in 962 bytes} [Sun Aug 28 00:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:09.683465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e791db3-7fe6-4a4a-9a95-a326f7f0ac95 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:09.707504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e791db3-7fe6-4a4a-9a95-a326f7f0ac95 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:09.707504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e791db3-7fe6-4a4a-9a95-a326f7f0ac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:09.707504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:09.777007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-9e791db3-7fe6-4a4a-9a95-a326f7f0ac95 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:09.778222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-9e791db3-7fe6-4a4a-9a95-a326f7f0ac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:09.904959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 678/1359] 10.222.0.58 () {58 vars in 1059 bytes} [Sun Aug 28 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:09.912568 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7954ed5-ec04-4e7a-b840-949509f77b66 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:09.914093 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a7954ed5-ec04-4e7a-b840-949509f77b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:10.094109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7954ed5-ec04-4e7a-b840-949509f77b66 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:10.184011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:10.229140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b2af1-993a-4073-bd51-c48ee36b2211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:10.229752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2af1-993a-4073-bd51-c48ee36b2211 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:10.230027 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2af1-993a-4073-bd51-c48ee36b2211 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:10.230297 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2af1-993a-4073-bd51-c48ee36b2211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:10.231932 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-ef7b2af1-993a-4073-bd51-c48ee36b2211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:10.330140 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b2af1-993a-4073-bd51-c48ee36b2211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:10.332163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b2af1-993a-4073-bd51-c48ee36b2211 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:10.352948 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 682/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:12.506458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a305e1-993e-432e-a0f2-0c6e09784b99 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:12.507035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a305e1-993e-432e-a0f2-0c6e09784b99 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:12.507035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a305e1-993e-432e-a0f2-0c6e09784b99 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:12.508541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 679/1361] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:12.514301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1839ad-c1df-4447-9481-5abafaeda51d None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:12.514758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1839ad-c1df-4447-9481-5abafaeda51d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:12.514842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1839ad-c1df-4447-9481-5abafaeda51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:12.584250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-3d1839ad-c1df-4447-9481-5abafaeda51d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:12.585485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-3d1839ad-c1df-4447-9481-5abafaeda51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:12.630182 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:12.697422 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 683/1362] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:13.002073 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a305e1-993e-432e-a0f2-0c6e09784b99 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:13.003655 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-07a305e1-993e-432e-a0f2-0c6e09784b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:13.080587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:13.168458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a305e1-993e-432e-a0f2-0c6e09784b99 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:13.295745 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e5463-a684-483c-97b3-7f0f2bf28c38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:13.296359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5463-a684-483c-97b3-7f0f2bf28c38 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:13.296743 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5463-a684-483c-97b3-7f0f2bf28c38 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:13.296885 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5463-a684-483c-97b3-7f0f2bf28c38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:13.298481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-557e5463-a684-483c-97b3-7f0f2bf28c38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:13.326289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:13.403926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e5463-a684-483c-97b3-7f0f2bf28c38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:13.406037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e5463-a684-483c-97b3-7f0f2bf28c38 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:13.426904 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 680/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:15.854702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750adb90-ba89-4326-9792-57889d97cf1e None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.855300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750adb90-ba89-4326-9792-57889d97cf1e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.855554 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750adb90-ba89-4326-9792-57889d97cf1e None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.857223 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 684/1364] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:15.862958 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4f16-a813-40a3-9d64-dfe535a8c0be None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.863437 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4f16-a813-40a3-9d64-dfe535a8c0be None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.863708 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4f16-a813-40a3-9d64-dfe535a8c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.942304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-4d1a4f16-a813-40a3-9d64-dfe535a8c0be None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:15.943491 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4d1a4f16-a813-40a3-9d64-dfe535a8c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.059059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:16.063138 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 681/1365] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:16.362125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2700db9-18dd-4635-ba0f-3883a5893afd None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.363487 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2700db9-18dd-4635-ba0f-3883a5893afd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.363843 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2700db9-18dd-4635-ba0f-3883a5893afd None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.365441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 685/1366] 10.222.0.58 () {54 vars in 962 bytes} [Sun Aug 28 00:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:16.371615 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba8cf-88a8-4e5e-a8f0-4a6fcff372fa None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.372609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba8cf-88a8-4e5e-a8f0-4a6fcff372fa None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.372902 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba8cf-88a8-4e5e-a8f0-4a6fcff372fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.461869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-5f7ba8cf-88a8-4e5e-a8f0-4a6fcff372fa None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:16.463222 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5f7ba8cf-88a8-4e5e-a8f0-4a6fcff372fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.597055 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 682/1367] 10.222.0.58 () {58 vars in 1059 bytes} [Sun Aug 28 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:16.605906 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2700db9-18dd-4635-ba0f-3883a5893afd None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:16.608397 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d2700db9-18dd-4635-ba0f-3883a5893afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.788024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2700db9-18dd-4635-ba0f-3883a5893afd None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:16.810581 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:16.921862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0221daf-85f6-4772-8293-78f271331383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:16.922475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221daf-85f6-4772-8293-78f271331383 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.922760 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221daf-85f6-4772-8293-78f271331383 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.922940 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221daf-85f6-4772-8293-78f271331383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.924566 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d0221daf-85f6-4772-8293-78f271331383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:17.019036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0221daf-85f6-4772-8293-78f271331383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.020744 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0221daf-85f6-4772-8293-78f271331383 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.040935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 686/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:17.460041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e9e1-787e-448a-a0b0-83b67bb3802e None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.460614 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e9e1-787e-448a-a0b0-83b67bb3802e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.460614 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e9e1-787e-448a-a0b0-83b67bb3802e None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.463135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 683/1369] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:17.469333 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732da6-4c9f-4a70-a402-86867974f3c8 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.470967 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732da6-4c9f-4a70-a402-86867974f3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.470967 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732da6-4c9f-4a70-a402-86867974f3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.502582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:17.540495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-58732da6-4c9f-4a70-a402-86867974f3c8 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:17.542658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-58732da6-4c9f-4a70-a402-86867974f3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:17.652826 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 687/1370] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:18.245952 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2b3a-da05-420e-99a3-2bf302b667f5 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.245952 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2b3a-da05-420e-99a3-2bf302b667f5 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.245952 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2b3a-da05-420e-99a3-2bf302b667f5 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.249353 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 684/1371] 10.222.0.58 () {54 vars in 964 bytes} [Sun Aug 28 00:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:18.252866 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc3197-69f4-416d-8df0-13d169d8a0f4 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.253338 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc3197-69f4-416d-8df0-13d169d8a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.253424 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc3197-69f4-416d-8df0-13d169d8a0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.339809 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-d1cc3197-69f4-416d-8df0-13d169d8a0f4 None None] MFA Rules not processed for user `c481bcb02495453f806fdc6a9d30ed58`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:18.341317 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d1cc3197-69f4-416d-8df0-13d169d8a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.394882 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:18.428702 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 688/1372] 10.222.0.58 () {58 vars in 1061 bytes} [Sun Aug 28 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:18.439184 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2b3a-da05-420e-99a3-2bf302b667f5 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:18.441015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-126e2b3a-da05-420e-99a3-2bf302b667f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.498854 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:18.558289 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2b3a-da05-420e-99a3-2bf302b667f5 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:18.644644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f8830-624a-4494-87f5-79fd3a5b0943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c481bcb02495453f806fdc6a9d30ed58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:18.644644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8830-624a-4494-87f5-79fd3a5b0943 service cinder] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.644644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8830-624a-4494-87f5-79fd3a5b0943 service cinder] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.644644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8830-624a-4494-87f5-79fd3a5b0943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.645297 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-9b8f8830-624a-4494-87f5-79fd3a5b0943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.749791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:18.763378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f8830-624a-4494-87f5-79fd3a5b0943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:18.764849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f8830-624a-4494-87f5-79fd3a5b0943 service cinder] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:18.787003 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 685/1373] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:19.277537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d8cd-1b89-4d35-b27b-a7994a75698e None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.278668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d8cd-1b89-4d35-b27b-a7994a75698e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.278864 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d8cd-1b89-4d35-b27b-a7994a75698e None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.280370 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 689/1374] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:19.285733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee7568-77f8-43b9-8cb2-87f8b56a80e9 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.286026 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee7568-77f8-43b9-8cb2-87f8b56a80e9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.286312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee7568-77f8-43b9-8cb2-87f8b56a80e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.353658 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-bfee7568-77f8-43b9-8cb2-87f8b56a80e9 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:19.354875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-bfee7568-77f8-43b9-8cb2-87f8b56a80e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:19.456092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 686/1375] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:19.749654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d8cd-1b89-4d35-b27b-a7994a75698e None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:19.751237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-22e9d8cd-1b89-4d35-b27b-a7994a75698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:19.899590 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d8cd-1b89-4d35-b27b-a7994a75698e None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:19.949998 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:20.011457 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37285477-d511-4759-bace-06a1dbc4d004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:20.012061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37285477-d511-4759-bace-06a1dbc4d004 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.012358 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37285477-d511-4759-bace-06a1dbc4d004 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.012643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37285477-d511-4759-bace-06a1dbc4d004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.014259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-37285477-d511-4759-bace-06a1dbc4d004 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:20.107044 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37285477-d511-4759-bace-06a1dbc4d004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:20.108955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37285477-d511-4759-bace-06a1dbc4d004 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:20.128300 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 690/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:22.412586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935aecb-c726-4a86-b600-471ba26e9a17 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:22.413146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935aecb-c726-4a86-b600-471ba26e9a17 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:22.413146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935aecb-c726-4a86-b600-471ba26e9a17 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:22.414469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 687/1377] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:22.420664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf185-9d14-40e1-a4d9-1f36fbabbb68 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:22.421150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf185-9d14-40e1-a4d9-1f36fbabbb68 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:22.421354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf185-9d14-40e1-a4d9-1f36fbabbb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:22.503786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-dd3cf185-9d14-40e1-a4d9-1f36fbabbb68 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:22.505021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-dd3cf185-9d14-40e1-a4d9-1f36fbabbb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:22.511794 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:22.631977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 691/1378] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:22.938742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935aecb-c726-4a86-b600-471ba26e9a17 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:22.940265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3935aecb-c726-4a86-b600-471ba26e9a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:23.008663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:23.096001 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935aecb-c726-4a86-b600-471ba26e9a17 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:23.218544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02b7f-422d-46f1-ac2b-8dc0abf04a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:23.219062 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02b7f-422d-46f1-ac2b-8dc0abf04a77 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:23.219432 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02b7f-422d-46f1-ac2b-8dc0abf04a77 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:23.219717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02b7f-422d-46f1-ac2b-8dc0abf04a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:23.221312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-1bc02b7f-422d-46f1-ac2b-8dc0abf04a77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:23.241349 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:23.315977 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc02b7f-422d-46f1-ac2b-8dc0abf04a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:23.317587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc02b7f-422d-46f1-ac2b-8dc0abf04a77 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:23.336892 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 688/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:25.434059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7b548-bf31-469a-8450-0bbb103a70b4 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:25.434631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7b548-bf31-469a-8450-0bbb103a70b4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:25.434925 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7b548-bf31-469a-8450-0bbb103a70b4 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:25.436579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 692/1380] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:25.441916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09ef74-879c-4d80-a88d-39ee2502e9aa None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:25.442747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09ef74-879c-4d80-a88d-39ee2502e9aa None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:25.442747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09ef74-879c-4d80-a88d-39ee2502e9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:25.522595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-8d09ef74-879c-4d80-a88d-39ee2502e9aa None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:25.523974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8d09ef74-879c-4d80-a88d-39ee2502e9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:25.630859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:25.637035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 689/1381] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:25.928400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7b548-bf31-469a-8450-0bbb103a70b4 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:25.929997 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-84f7b548-bf31-469a-8450-0bbb103a70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:26.077238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:26.088107 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7b548-bf31-469a-8450-0bbb103a70b4 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:26.211302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba30c0-b803-4330-8cfe-2e220229a824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:26.211830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba30c0-b803-4330-8cfe-2e220229a824 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:26.212115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba30c0-b803-4330-8cfe-2e220229a824 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:26.212376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba30c0-b803-4330-8cfe-2e220229a824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:26.214053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-5bba30c0-b803-4330-8cfe-2e220229a824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:26.311427 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba30c0-b803-4330-8cfe-2e220229a824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:26.313082 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba30c0-b803-4330-8cfe-2e220229a824 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:26.323412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:26.333317 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 693/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:29.010646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26446c9-68fa-40e2-ae2a-77adda9ed382 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:29.011301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26446c9-68fa-40e2-ae2a-77adda9ed382 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:29.011301 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26446c9-68fa-40e2-ae2a-77adda9ed382 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:29.013512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 690/1383] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:29.019180 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a262-200d-45a6-9bdf-d38e53366a30 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:29.019712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a262-200d-45a6-9bdf-d38e53366a30 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:29.019712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a262-200d-45a6-9bdf-d38e53366a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:29.095910 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-5bd8a262-200d-45a6-9bdf-d38e53366a30 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:29.097458 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-5bd8a262-200d-45a6-9bdf-d38e53366a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:29.217539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 694/1384] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:29.512319 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26446c9-68fa-40e2-ae2a-77adda9ed382 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:29.514111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-a26446c9-68fa-40e2-ae2a-77adda9ed382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:29.683042 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26446c9-68fa-40e2-ae2a-77adda9ed382 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:29.765086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:29.822293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98599a7e-28de-489f-bcc3-c2e1cfa12f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:29.823070 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599a7e-28de-489f-bcc3-c2e1cfa12f36 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:29.823460 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599a7e-28de-489f-bcc3-c2e1cfa12f36 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:29.823799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599a7e-28de-489f-bcc3-c2e1cfa12f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:29.826169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-98599a7e-28de-489f-bcc3-c2e1cfa12f36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:29.931229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98599a7e-28de-489f-bcc3-c2e1cfa12f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:29.932922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98599a7e-28de-489f-bcc3-c2e1cfa12f36 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:29.953372 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 691/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:32.460745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacae3ed-f799-4444-889f-5690671daded None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:32.461244 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacae3ed-f799-4444-889f-5690671daded None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:32.461244 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacae3ed-f799-4444-889f-5690671daded None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:32.462563 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 695/1386] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:32.469686 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10293e-0027-4b9a-b5ad-b604afdebac0 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:32.470211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10293e-0027-4b9a-b5ad-b604afdebac0 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:32.470211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10293e-0027-4b9a-b5ad-b604afdebac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:32.551368 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0e10293e-0027-4b9a-b5ad-b604afdebac0 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:32.552591 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0e10293e-0027-4b9a-b5ad-b604afdebac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:32.588306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:32.655641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 692/1387] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:32.946480 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacae3ed-f799-4444-889f-5690671daded None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:32.948043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-dacae3ed-f799-4444-889f-5690671daded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:33.025841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:33.101024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacae3ed-f799-4444-889f-5690671daded None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:33.216904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c87e70-384c-436a-a68d-354641648c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:33.217417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87e70-384c-436a-a68d-354641648c4c service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:33.217692 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87e70-384c-436a-a68d-354641648c4c service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:33.217963 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87e70-384c-436a-a68d-354641648c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:33.219603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-48c87e70-384c-436a-a68d-354641648c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:33.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:33.309346 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c87e70-384c-436a-a68d-354641648c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:33.310971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c87e70-384c-436a-a68d-354641648c4c service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:33.330589 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 696/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:34.365388 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af3a0-c58f-4114-a964-8363937db6ab None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:34.365943 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af3a0-c58f-4114-a964-8363937db6ab None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:34.366132 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af3a0-c58f-4114-a964-8363937db6ab None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:34.367512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 693/1389] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:34.373439 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f685f6-b7f3-4c3d-9606-47f160f96f17 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:34.373840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f685f6-b7f3-4c3d-9606-47f160f96f17 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:34.374004 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f685f6-b7f3-4c3d-9606-47f160f96f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:34.444049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-42f685f6-b7f3-4c3d-9606-47f160f96f17 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:34.445155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-42f685f6-b7f3-4c3d-9606-47f160f96f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:34.554533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 697/1390] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:34.858264 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7295-abd0-4932-aa5a-2341fd69b17f None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:34.858624 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7295-abd0-4932-aa5a-2341fd69b17f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:34.858984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7295-abd0-4932-aa5a-2341fd69b17f None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:34.860402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 694/1391] 10.222.0.58 () {54 vars in 967 bytes} [Sun Aug 28 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:34.865763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013195-daba-4c4a-a50b-9b992d6b739f None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:34.866048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013195-daba-4c4a-a50b-9b992d6b739f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:34.866326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013195-daba-4c4a-a50b-9b992d6b739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:34.887393 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:34.949030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-2f013195-daba-4c4a-a50b-9b992d6b739f None None] MFA Rules not processed for user `9bc80df87ba14b3595e171a0e8fd6f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:34.950515 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2f013195-daba-4c4a-a50b-9b992d6b739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:35.027032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 698/1392] 10.222.0.58 () {58 vars in 1064 bytes} [Sun Aug 28 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:35.035442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb7295-abd0-4932-aa5a-2341fd69b17f None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:35.037046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e2eb7295-abd0-4932-aa5a-2341fd69b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:35.142350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb7295-abd0-4932-aa5a-2341fd69b17f None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:35.203354 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:35.221074 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af55dd4-44ff-4fbb-a26f-987dc8a641e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc80df87ba14b3595e171a0e8fd6f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:35.221679 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55dd4-44ff-4fbb-a26f-987dc8a641e8 service glance] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:35.221956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55dd4-44ff-4fbb-a26f-987dc8a641e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:35.222225 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55dd4-44ff-4fbb-a26f-987dc8a641e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:35.223864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-9af55dd4-44ff-4fbb-a26f-987dc8a641e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:35.336633 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af55dd4-44ff-4fbb-a26f-987dc8a641e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:35.338080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af55dd4-44ff-4fbb-a26f-987dc8a641e8 service glance] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:35.357816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 695/1393] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:35.443396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31249477-2727-4324-8df7-90a3309055a8 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:35.443899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31249477-2727-4324-8df7-90a3309055a8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:35.443899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31249477-2727-4324-8df7-90a3309055a8 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:35.449913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 699/1394] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:35.452093 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bffc2-3055-4498-97d5-19f136810091 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:35.452525 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bffc2-3055-4498-97d5-19f136810091 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:35.452631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bffc2-3055-4498-97d5-19f136810091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:35.522767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-4a2bffc2-3055-4498-97d5-19f136810091 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:35.524020 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4a2bffc2-3055-4498-97d5-19f136810091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:35.566446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:35.633431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 696/1395] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:35.931557 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31249477-2727-4324-8df7-90a3309055a8 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:35.933355 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-31249477-2727-4324-8df7-90a3309055a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:36.044462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:36.098021 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31249477-2727-4324-8df7-90a3309055a8 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:36.216542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3023-f51c-404a-a19c-3de30c1f4cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:36.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3023-f51c-404a-a19c-3de30c1f4cce service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:36.217421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3023-f51c-404a-a19c-3de30c1f4cce service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:36.217691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3023-f51c-404a-a19c-3de30c1f4cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:36.219421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-32eb3023-f51c-404a-a19c-3de30c1f4cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:36.266890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfed645-2000-4242-9a1e-761fe26f8476 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:36.267369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfed645-2000-4242-9a1e-761fe26f8476 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:36.267548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfed645-2000-4242-9a1e-761fe26f8476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:36.296491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:36.316883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb3023-f51c-404a-a19c-3de30c1f4cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:36.318550 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb3023-f51c-404a-a19c-3de30c1f4cce service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:36.336280 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0cfed645-2000-4242-9a1e-761fe26f8476 None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:36.337575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0cfed645-2000-4242-9a1e-761fe26f8476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:36.338642 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 700/1396] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:36.431240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 697/1397] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:36.488064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b397e-bdec-4487-ac87-96825b4c9986 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:36.488586 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b397e-bdec-4487-ac87-96825b4c9986 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:36.488681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b397e-bdec-4487-ac87-96825b4c9986 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:36.490061 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 701/1398] 10.222.0.58 () {54 vars in 943 bytes} [Sun Aug 28 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:36.496826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d3d9-fb63-45cb-aa6a-3ef44ca3297b None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:36.497380 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d3d9-fb63-45cb-aa6a-3ef44ca3297b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:36.497550 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739d3d9-fb63-45cb-aa6a-3ef44ca3297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:36.551541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:36.596308 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-6739d3d9-fb63-45cb-aa6a-3ef44ca3297b None None] MFA Rules not processed for user `71cc361c23f94761bec36dec15efe691`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:36.597691 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6739d3d9-fb63-45cb-aa6a-3ef44ca3297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:36.724789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 698/1399] 10.222.0.58 () {58 vars in 1040 bytes} [Sun Aug 28 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:36.734695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b397e-bdec-4487-ac87-96825b4c9986 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:36.736359 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-215b397e-bdec-4487-ac87-96825b4c9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:36.882092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b397e-bdec-4487-ac87-96825b4c9986 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:36.938275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:36.986913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42a268-bdbf-4bea-9128-7b9a8aca0a1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:36.987561 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a268-bdbf-4bea-9128-7b9a8aca0a1d service swift] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:36.987829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a268-bdbf-4bea-9128-7b9a8aca0a1d service swift] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:36.988092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a268-bdbf-4bea-9128-7b9a8aca0a1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:36.989723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-7c42a268-bdbf-4bea-9128-7b9a8aca0a1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:37.073994 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42a268-bdbf-4bea-9128-7b9a8aca0a1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:37.075678 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42a268-bdbf-4bea-9128-7b9a8aca0a1d service swift] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:37.084299 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 702/1400] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 00:58:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 00:58:38.475204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2be896-25cc-4e81-bc8d-58f7adfd4487 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:38.475721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2be896-25cc-4e81-bc8d-58f7adfd4487 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:38.475721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2be896-25cc-4e81-bc8d-58f7adfd4487 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:38.477174 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 699/1401] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:38.482402 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f2f14-795d-4f92-8446-fbe055627278 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:38.482841 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f2f14-795d-4f92-8446-fbe055627278 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:38.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f2f14-795d-4f92-8446-fbe055627278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:38.559565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-673f2f14-795d-4f92-8446-fbe055627278 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:38.560029 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-673f2f14-795d-4f92-8446-fbe055627278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:38.611085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:38.683131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 703/1402] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:38.967779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2be896-25cc-4e81-bc8d-58f7adfd4487 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:38.969283 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6d2be896-25cc-4e81-bc8d-58f7adfd4487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:39.065049 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:39.129637 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2be896-25cc-4e81-bc8d-58f7adfd4487 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:39.261604 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a686c3-cba7-496b-b703-425ad5134a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:39.262580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a686c3-cba7-496b-b703-425ad5134a2e service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:39.262862 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a686c3-cba7-496b-b703-425ad5134a2e service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:39.263178 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a686c3-cba7-496b-b703-425ad5134a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:39.264866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-09a686c3-cba7-496b-b703-425ad5134a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:39.330134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:39.368922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a686c3-cba7-496b-b703-425ad5134a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:39.370526 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a686c3-cba7-496b-b703-425ad5134a2e service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:39.390544 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 700/1403] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:41.528266 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66b10-9289-4533-89fb-22af6b4766d1 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:41.528867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66b10-9289-4533-89fb-22af6b4766d1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:41.528867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66b10-9289-4533-89fb-22af6b4766d1 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:41.530148 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 704/1404] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:41.536546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d496-7738-432a-8ff7-af2cdebe6654 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:41.536546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d496-7738-432a-8ff7-af2cdebe6654 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:41.536546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d496-7738-432a-8ff7-af2cdebe6654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:41.611252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e842d496-7738-432a-8ff7-af2cdebe6654 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:41.612469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e842d496-7738-432a-8ff7-af2cdebe6654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:41.724523 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 701/1405] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:42.018560 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66b10-9289-4533-89fb-22af6b4766d1 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:42.020132 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-3aa66b10-9289-4533-89fb-22af6b4766d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:42.191637 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66b10-9289-4533-89fb-22af6b4766d1 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:42.220708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:42.318990 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe9ba8-a015-4dbc-86f2-ed0de74da7e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:42.319650 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9ba8-a015-4dbc-86f2-ed0de74da7e8 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:42.319929 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9ba8-a015-4dbc-86f2-ed0de74da7e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:42.320201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9ba8-a015-4dbc-86f2-ed0de74da7e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:42.323799 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-29fe9ba8-a015-4dbc-86f2-ed0de74da7e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:42.436905 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe9ba8-a015-4dbc-86f2-ed0de74da7e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:42.440064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe9ba8-a015-4dbc-86f2-ed0de74da7e8 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:42.463301 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 705/1406] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:44.596835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19183-e512-4c22-b8fb-ffa3df7fef78 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:44.596835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19183-e512-4c22-b8fb-ffa3df7fef78 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:44.596835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e19183-e512-4c22-b8fb-ffa3df7fef78 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:44.601111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 702/1407] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 00:58:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:44.602784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f8b76-24ce-4f9d-9694-b5be2cbdbf32 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:44.603699 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f8b76-24ce-4f9d-9694-b5be2cbdbf32 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:44.603986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f8b76-24ce-4f9d-9694-b5be2cbdbf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:44.649641 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:44.688537 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-2b5f8b76-24ce-4f9d-9694-b5be2cbdbf32 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:44.689780 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2b5f8b76-24ce-4f9d-9694-b5be2cbdbf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:44.805454 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 706/1408] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 00:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:45.102190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e19183-e512-4c22-b8fb-ffa3df7fef78 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:45.103788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-36e19183-e512-4c22-b8fb-ffa3df7fef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:45.144678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:45.275262 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e19183-e512-4c22-b8fb-ffa3df7fef78 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:45.404647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:45.413515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d397498-74b2-4388-b1f7-c9ae237b5287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:45.414169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397498-74b2-4388-b1f7-c9ae237b5287 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:45.414516 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397498-74b2-4388-b1f7-c9ae237b5287 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:45.414790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397498-74b2-4388-b1f7-c9ae237b5287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:45.416585 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-1d397498-74b2-4388-b1f7-c9ae237b5287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:45.516358 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d397498-74b2-4388-b1f7-c9ae237b5287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:45.517962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d397498-74b2-4388-b1f7-c9ae237b5287 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:45.540848 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 703/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:54.803580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=52 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:55.546461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=48 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:01.328543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12232ab7-b6cf-44b4-bba7-3bff5f9bcd58 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:01.329186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12232ab7-b6cf-44b4-bba7-3bff5f9bcd58 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:01.329186 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12232ab7-b6cf-44b4-bba7-3bff5f9bcd58 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:01.330412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 707/1410] 10.222.0.58 () {54 vars in 918 bytes} [Sun Aug 28 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:01.335453 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ec8ed-9e7e-4824-893c-57671994ca9d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:01.335921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ec8ed-9e7e-4824-893c-57671994ca9d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:01.336051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ec8ed-9e7e-4824-893c-57671994ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:01.412268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d21ec8ed-9e7e-4824-893c-57671994ca9d None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:01.413533 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d21ec8ed-9e7e-4824-893c-57671994ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:01.522923 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 704/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Sun Aug 28 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:01.537964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c078aab-f70b-4c88-84d1-4b034d56a336 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:01.538250 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c078aab-f70b-4c88-84d1-4b034d56a336 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:01.538524 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c078aab-f70b-4c88-84d1-4b034d56a336 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:01.539902 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 708/1412] 10.222.0.58 () {54 vars in 918 bytes} [Sun Aug 28 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:01.544557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4f97-e91f-4c3d-b80b-7dcea3233f86 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:01.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4f97-e91f-4c3d-b80b-7dcea3233f86 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:01.545121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4f97-e91f-4c3d-b80b-7dcea3233f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:01.617302 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:01.620589 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d26b4f97-e91f-4c3d-b80b-7dcea3233f86 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:01.621890 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d26b4f97-e91f-4c3d-b80b-7dcea3233f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:01.740924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 705/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Sun Aug 28 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:04.189555 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365a32-a27f-4306-ab42-ea20baf11fea None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:04.190023 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365a32-a27f-4306-ab42-ea20baf11fea None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:04.190130 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365a32-a27f-4306-ab42-ea20baf11fea None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:04.191464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:04.196765 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875f38-c10b-43ee-8579-7c2ffeeefde9 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:04.197174 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875f38-c10b-43ee-8579-7c2ffeeefde9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:04.197326 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875f38-c10b-43ee-8579-7c2ffeeefde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:04.265465 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e0875f38-c10b-43ee-8579-7c2ffeeefde9 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:04.266685 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e0875f38-c10b-43ee-8579-7c2ffeeefde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:04.324114 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:04.366964 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:04.664111 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365a32-a27f-4306-ab42-ea20baf11fea None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:04.666030 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-37365a32-a27f-4306-ab42-ea20baf11fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:04.812163 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365a32-a27f-4306-ab42-ea20baf11fea None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:04.886436 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:04.926565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade09c0-b3e7-4470-a2b0-62be574b8f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:04.927125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade09c0-b3e7-4470-a2b0-62be574b8f58 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:04.927406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade09c0-b3e7-4470-a2b0-62be574b8f58 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:04.927676 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade09c0-b3e7-4470-a2b0-62be574b8f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:04.929267 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2ade09c0-b3e7-4470-a2b0-62be574b8f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:05.018765 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade09c0-b3e7-4470-a2b0-62be574b8f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:05.020404 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade09c0-b3e7-4470-a2b0-62be574b8f58 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:05.038438 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 710/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:05.930704 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b01b1-be88-4f56-8643-8704646deb0b None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:05.931254 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b01b1-be88-4f56-8643-8704646deb0b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:05.931254 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b01b1-be88-4f56-8643-8704646deb0b None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:05.933184 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:05.938616 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca33a-2f8b-40cd-a513-a1b796b617e7 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:05.939051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca33a-2f8b-40cd-a513-a1b796b617e7 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:05.939237 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca33a-2f8b-40cd-a513-a1b796b617e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:06.016225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-39eca33a-2f8b-40cd-a513-a1b796b617e7 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:06.017432 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-39eca33a-2f8b-40cd-a513-a1b796b617e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:06.045137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:06.114987 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:06.265417 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b01b1-be88-4f56-8643-8704646deb0b None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:06.266863 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-248b01b1-be88-4f56-8643-8704646deb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:06.418346 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b01b1-be88-4f56-8643-8704646deb0b None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:06.460169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:06.534169 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec6fad-d2b0-40fd-9f11-eff206f58253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:06.534788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6fad-d2b0-40fd-9f11-eff206f58253 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:06.535067 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6fad-d2b0-40fd-9f11-eff206f58253 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:06.535367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6fad-d2b0-40fd-9f11-eff206f58253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:06.536990 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-16ec6fad-d2b0-40fd-9f11-eff206f58253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:06.630640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec6fad-d2b0-40fd-9f11-eff206f58253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:06.632359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec6fad-d2b0-40fd-9f11-eff206f58253 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:06.651605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 708/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:07.552034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666981f-2472-4e7f-a867-1d672505daa4 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:07.552556 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666981f-2472-4e7f-a867-1d672505daa4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:07.552695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666981f-2472-4e7f-a867-1d672505daa4 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:07.553966 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:07.559117 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6127f-7e43-449c-9b36-d789cf683ec9 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:07.559534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6127f-7e43-449c-9b36-d789cf683ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:07.559792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6127f-7e43-449c-9b36-d789cf683ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:07.615739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:07.637891 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-aee6127f-7e43-449c-9b36-d789cf683ec9 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:07.639031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-aee6127f-7e43-449c-9b36-d789cf683ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:07.738451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:07.890623 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666981f-2472-4e7f-a867-1d672505daa4 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:07.892464 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6666981f-2472-4e7f-a867-1d672505daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:08.041325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666981f-2472-4e7f-a867-1d672505daa4 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:08.054011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:08.155619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f48d2b-fea1-4c15-ba1d-7fe38d300285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:08.156168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48d2b-fea1-4c15-ba1d-7fe38d300285 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:08.156441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48d2b-fea1-4c15-ba1d-7fe38d300285 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:08.156710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48d2b-fea1-4c15-ba1d-7fe38d300285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:08.158315 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-41f48d2b-fea1-4c15-ba1d-7fe38d300285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:08.247538 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f48d2b-fea1-4c15-ba1d-7fe38d300285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:08.249133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f48d2b-fea1-4c15-ba1d-7fe38d300285 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:08.267517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 713/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:09.152504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c495ee-bc42-403c-a1dc-b9d70afc7df2 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:09.153126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c495ee-bc42-403c-a1dc-b9d70afc7df2 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:09.153126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c495ee-bc42-403c-a1dc-b9d70afc7df2 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:09.154403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:09.159514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2320-74ed-4338-9f06-35c23dca35b1 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:09.159953 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2320-74ed-4338-9f06-35c23dca35b1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:09.160052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2320-74ed-4338-9f06-35c23dca35b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:09.180329 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:09.238571 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c6db2320-74ed-4338-9f06-35c23dca35b1 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:09.239825 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c6db2320-74ed-4338-9f06-35c23dca35b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:09.337368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:09.490778 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c495ee-bc42-403c-a1dc-b9d70afc7df2 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:09.492335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-66c495ee-bc42-403c-a1dc-b9d70afc7df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:09.603787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:09.642317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c495ee-bc42-403c-a1dc-b9d70afc7df2 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:09.758394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65ba7c-42e9-4384-a2ab-751cec45ca89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:09.758997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ba7c-42e9-4384-a2ab-751cec45ca89 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:09.759304 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ba7c-42e9-4384-a2ab-751cec45ca89 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:09.759573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65ba7c-42e9-4384-a2ab-751cec45ca89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:09.761862 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-da65ba7c-42e9-4384-a2ab-751cec45ca89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:09.837380 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:09.850647 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65ba7c-42e9-4384-a2ab-751cec45ca89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:09.852778 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65ba7c-42e9-4384-a2ab-751cec45ca89 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:09.871128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 711/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:10.743494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4def-2e74-4d52-bb80-98e20e7c9206 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:10.744059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4def-2e74-4d52-bb80-98e20e7c9206 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:10.744059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4def-2e74-4d52-bb80-98e20e7c9206 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:10.746134 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:10.751201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802c1a7-fc04-48b6-b7bd-587cb5368947 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:10.751693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802c1a7-fc04-48b6-b7bd-587cb5368947 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:10.751788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802c1a7-fc04-48b6-b7bd-587cb5368947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:10.829113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c802c1a7-fc04-48b6-b7bd-587cb5368947 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:10.830322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c802c1a7-fc04-48b6-b7bd-587cb5368947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:10.928632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:11.084635 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4def-2e74-4d52-bb80-98e20e7c9206 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:11.086252 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-531c4def-2e74-4d52-bb80-98e20e7c9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:11.171904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:11.235085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4def-2e74-4d52-bb80-98e20e7c9206 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:11.352275 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f499c33-701a-41b8-b0dc-073f79b2a9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:11.352875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499c33-701a-41b8-b0dc-073f79b2a9b1 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:11.353142 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499c33-701a-41b8-b0dc-073f79b2a9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:11.353406 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499c33-701a-41b8-b0dc-073f79b2a9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:11.355053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-4f499c33-701a-41b8-b0dc-073f79b2a9b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:11.404051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:11.444821 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f499c33-701a-41b8-b0dc-073f79b2a9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:11.446493 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f499c33-701a-41b8-b0dc-073f79b2a9b1 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:11.466388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 716/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:12.332160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d677bf-9c15-4bd3-8486-7f82db5db4a7 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.332813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d677bf-9c15-4bd3-8486-7f82db5db4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.332813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d677bf-9c15-4bd3-8486-7f82db5db4a7 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.334134 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:12.339594 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7f64-779a-44f6-bbdf-0a81257ea3a4 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.340034 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7f64-779a-44f6-bbdf-0a81257ea3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.340139 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7f64-779a-44f6-bbdf-0a81257ea3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.420293 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a2be7f64-779a-44f6-bbdf-0a81257ea3a4 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:12.425326 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a2be7f64-779a-44f6-bbdf-0a81257ea3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:12.528733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:12.679796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d677bf-9c15-4bd3-8486-7f82db5db4a7 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.681244 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-62d677bf-9c15-4bd3-8486-7f82db5db4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:12.733607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:12.831763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d677bf-9c15-4bd3-8486-7f82db5db4a7 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:12.944645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7bfc8-7da3-4fc8-978c-25b3310b2e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:12.945159 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7bfc8-7da3-4fc8-978c-25b3310b2e93 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:12.945437 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7bfc8-7da3-4fc8-978c-25b3310b2e93 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:12.945700 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7bfc8-7da3-4fc8-978c-25b3310b2e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:12.947309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-37a7bfc8-7da3-4fc8-978c-25b3310b2e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:12.955211 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:13.038325 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7bfc8-7da3-4fc8-978c-25b3310b2e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.039935 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7bfc8-7da3-4fc8-978c-25b3310b2e93 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.058092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 714/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:13.937125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae3481-e4df-4ffe-8b04-d678d831ad5a None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.937654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae3481-e4df-4ffe-8b04-d678d831ad5a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.937654 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae3481-e4df-4ffe-8b04-d678d831ad5a None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.938980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:13.944116 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407246dd-f7ec-4a62-a2f2-0a67cdd8b06f None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.944534 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407246dd-f7ec-4a62-a2f2-0a67cdd8b06f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.944702 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407246dd-f7ec-4a62-a2f2-0a67cdd8b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:14.021632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-407246dd-f7ec-4a62-a2f2-0a67cdd8b06f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:14.022845 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-407246dd-f7ec-4a62-a2f2-0a67cdd8b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:14.091793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:14.121194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:14.273463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae3481-e4df-4ffe-8b04-d678d831ad5a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:14.275075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-54ae3481-e4df-4ffe-8b04-d678d831ad5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:14.293154 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:14.423472 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae3481-e4df-4ffe-8b04-d678d831ad5a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:14.513031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:14.539183 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ce9a-d507-4c67-843e-352a098686df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:14.539749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ce9a-d507-4c67-843e-352a098686df service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:14.540018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ce9a-d507-4c67-843e-352a098686df service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:14.540280 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ce9a-d507-4c67-843e-352a098686df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:14.541961 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c936ce9a-d507-4c67-843e-352a098686df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:14.631629 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ce9a-d507-4c67-843e-352a098686df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:14.633232 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ce9a-d507-4c67-843e-352a098686df service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:14.652127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 719/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:15.527451 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9c9bd-8f47-421a-9f29-91e125ed9010 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.528027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9c9bd-8f47-421a-9f29-91e125ed9010 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.528027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9c9bd-8f47-421a-9f29-91e125ed9010 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.529348 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:15.534575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4168ee-ae6f-45d3-afd8-fd2c38a5af4e None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.535003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4168ee-ae6f-45d3-afd8-fd2c38a5af4e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.535157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4168ee-ae6f-45d3-afd8-fd2c38a5af4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.611353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-af4168ee-ae6f-45d3-afd8-fd2c38a5af4e None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:15.612625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-af4168ee-ae6f-45d3-afd8-fd2c38a5af4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:15.655435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:15.710395 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:15.864188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9c9bd-8f47-421a-9f29-91e125ed9010 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:15.865694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-bec9c9bd-8f47-421a-9f29-91e125ed9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:16.017160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9c9bd-8f47-421a-9f29-91e125ed9010 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.072459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:16.131821 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065368-3a79-4337-ae61-d54b7fecaf0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.132434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065368-3a79-4337-ae61-d54b7fecaf0d service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.132741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065368-3a79-4337-ae61-d54b7fecaf0d service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.133015 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065368-3a79-4337-ae61-d54b7fecaf0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.134726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-83065368-3a79-4337-ae61-d54b7fecaf0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:16.226470 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065368-3a79-4337-ae61-d54b7fecaf0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.228195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065368-3a79-4337-ae61-d54b7fecaf0d service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.246638 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 717/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:17.118608 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401bc-2469-418e-965b-f781e40f99b0 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:17.119190 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401bc-2469-418e-965b-f781e40f99b0 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:17.119291 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401bc-2469-418e-965b-f781e40f99b0 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:17.120880 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:17.125995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d058-01c4-499e-964f-933b6fec287a None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:17.129933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d058-01c4-499e-964f-933b6fec287a None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:17.129933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d058-01c4-499e-964f-933b6fec287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:17.205112 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0f66d058-01c4-499e-964f-933b6fec287a None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:17.206344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0f66d058-01c4-499e-964f-933b6fec287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:17.208399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:17.303965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:17.458160 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401bc-2469-418e-965b-f781e40f99b0 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:17.459596 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-987401bc-2469-418e-965b-f781e40f99b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:17.604837 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401bc-2469-418e-965b-f781e40f99b0 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:17.632076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:17.719945 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df31c0-144b-4c7e-a2c1-51586ffa1d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:17.720479 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df31c0-144b-4c7e-a2c1-51586ffa1d09 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:17.720758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df31c0-144b-4c7e-a2c1-51586ffa1d09 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:17.721028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df31c0-144b-4c7e-a2c1-51586ffa1d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:17.722643 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d4df31c0-144b-4c7e-a2c1-51586ffa1d09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:17.812451 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df31c0-144b-4c7e-a2c1-51586ffa1d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:17.814170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df31c0-144b-4c7e-a2c1-51586ffa1d09 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:17.832968 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 722/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:19.662337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7b2b-7bd5-46f9-922d-ce9ab95b4b64 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:19.662887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7b2b-7bd5-46f9-922d-ce9ab95b4b64 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:19.662887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7b2b-7bd5-46f9-922d-ce9ab95b4b64 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:19.664272 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:19.670374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929e78-8ecd-4841-a312-2999c8d6ebc3 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:19.670771 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929e78-8ecd-4841-a312-2999c8d6ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:19.670922 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929e78-8ecd-4841-a312-2999c8d6ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:19.711723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:19.736557 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-3d929e78-8ecd-4841-a312-2999c8d6ebc3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:19.740876 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-3d929e78-8ecd-4841-a312-2999c8d6ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:19.833801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:20.124503 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f7b2b-7bd5-46f9-922d-ce9ab95b4b64 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:20.126087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4a0f7b2b-7bd5-46f9-922d-ce9ab95b4b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:20.233517 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f7b2b-7bd5-46f9-922d-ce9ab95b4b64 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:20.266661 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:20.309607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05b6d3-3881-432d-a4ed-831fbe8af725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:20.310217 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b6d3-3881-432d-a4ed-831fbe8af725 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:20.310496 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b6d3-3881-432d-a4ed-831fbe8af725 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:20.310766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b6d3-3881-432d-a4ed-831fbe8af725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:20.312445 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ba05b6d3-3881-432d-a4ed-831fbe8af725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:20.424684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05b6d3-3881-432d-a4ed-831fbe8af725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:20.426121 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05b6d3-3881-432d-a4ed-831fbe8af725 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:20.445190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 720/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:22.524228 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e1ab-2ace-4bf7-b863-c52396d4ea64 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:22.524796 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e1ab-2ace-4bf7-b863-c52396d4ea64 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:22.524895 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e1ab-2ace-4bf7-b863-c52396d4ea64 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:22.526401 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:22.532756 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f43e7-d2ec-4e82-84ac-64199302e04e None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:22.533250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f43e7-d2ec-4e82-84ac-64199302e04e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:22.533359 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f43e7-d2ec-4e82-84ac-64199302e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:22.618064 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-341f43e7-d2ec-4e82-84ac-64199302e04e None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:22.619878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-341f43e7-d2ec-4e82-84ac-64199302e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:22.633856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:22.739617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:23.079813 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e1ab-2ace-4bf7-b863-c52396d4ea64 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:23.081398 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-9d94e1ab-2ace-4bf7-b863-c52396d4ea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:23.209881 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e1ab-2ace-4bf7-b863-c52396d4ea64 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:23.224051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:23.286898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d1a3a-2cf2-42e9-8136-d42968def71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:23.287531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1a3a-2cf2-42e9-8136-d42968def71e service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:23.287803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1a3a-2cf2-42e9-8136-d42968def71e service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:23.288070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1a3a-2cf2-42e9-8136-d42968def71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:23.289663 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-9f0d1a3a-2cf2-42e9-8136-d42968def71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:23.521904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d1a3a-2cf2-42e9-8136-d42968def71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:23.523368 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d1a3a-2cf2-42e9-8136-d42968def71e service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:23.542203 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 725/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:25.833379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d14c7-5769-4fba-9fac-826fdc3f3553 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:25.833955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d14c7-5769-4fba-9fac-826fdc3f3553 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:25.833955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d14c7-5769-4fba-9fac-826fdc3f3553 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:25.835317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:25.840579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc949f-306c-4227-9f18-39a6ae869996 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:25.840985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc949f-306c-4227-9f18-39a6ae869996 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:25.841115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc949f-306c-4227-9f18-39a6ae869996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:25.889440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:25.908018 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-8afc949f-306c-4227-9f18-39a6ae869996 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:25.909234 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-8afc949f-306c-4227-9f18-39a6ae869996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:26.006181 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:26.298982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d14c7-5769-4fba-9fac-826fdc3f3553 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:26.300556 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-fb2d14c7-5769-4fba-9fac-826fdc3f3553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:26.407293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d14c7-5769-4fba-9fac-826fdc3f3553 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:26.448939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:26.484557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa1866-d663-4b08-be10-675f6441211e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:26.485203 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa1866-d663-4b08-be10-675f6441211e service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:26.485481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa1866-d663-4b08-be10-675f6441211e service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:26.485754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa1866-d663-4b08-be10-675f6441211e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:26.487500 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-2afa1866-d663-4b08-be10-675f6441211e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:26.598570 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa1866-d663-4b08-be10-675f6441211e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:26.600019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa1866-d663-4b08-be10-675f6441211e service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:26.619785 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 723/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:59:28.655680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6df1d-e635-4d79-8225-e0f33a3978fa None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:28.656205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6df1d-e635-4d79-8225-e0f33a3978fa None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:28.656205 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6df1d-e635-4d79-8225-e0f33a3978fa None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:28.657562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:28.663175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8136a2-9780-44c5-af09-8b9af1cdecf3 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:28.663625 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8136a2-9780-44c5-af09-8b9af1cdecf3 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:28.663728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8136a2-9780-44c5-af09-8b9af1cdecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:28.730111 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-4f8136a2-9780-44c5-af09-8b9af1cdecf3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:28.731384 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4f8136a2-9780-44c5-af09-8b9af1cdecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:28.756955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:28.836663 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:29.133278 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6df1d-e635-4d79-8225-e0f33a3978fa None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:29.134834 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-efc6df1d-e635-4d79-8225-e0f33a3978fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:29.237796 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6df1d-e635-4d79-8225-e0f33a3978fa None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:29.263363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:29.316002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d806b2-5a5f-47fe-a8be-77ec7e3636f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:29.316603 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d806b2-5a5f-47fe-a8be-77ec7e3636f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:29.316875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d806b2-5a5f-47fe-a8be-77ec7e3636f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:29.317139 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d806b2-5a5f-47fe-a8be-77ec7e3636f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:29.318708 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-90d806b2-5a5f-47fe-a8be-77ec7e3636f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:29.428742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d806b2-5a5f-47fe-a8be-77ec7e3636f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:29.430085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d806b2-5a5f-47fe-a8be-77ec7e3636f8 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:29.450463 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 728/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:31.432918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76516-0dfc-41ee-a7e1-9bd224351be1 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:31.433506 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76516-0dfc-41ee-a7e1-9bd224351be1 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:31.433506 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76516-0dfc-41ee-a7e1-9bd224351be1 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:31.434945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:31.440934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd8e0-0b41-4374-bbc4-9e63143c4f9c None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:31.441444 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd8e0-0b41-4374-bbc4-9e63143c4f9c None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:31.441543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd8e0-0b41-4374-bbc4-9e63143c4f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:31.507256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:31.511060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-baccd8e0-0b41-4374-bbc4-9e63143c4f9c None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:31.512354 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-baccd8e0-0b41-4374-bbc4-9e63143c4f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:31.613664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:31.902915 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76516-0dfc-41ee-a7e1-9bd224351be1 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:31.904503 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-fcc76516-0dfc-41ee-a7e1-9bd224351be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:32.016513 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76516-0dfc-41ee-a7e1-9bd224351be1 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:32.069381 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:32.097438 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b60411-de0b-4995-913e-a4fb6eadba2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:32.098050 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60411-de0b-4995-913e-a4fb6eadba2d service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:32.098330 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60411-de0b-4995-913e-a4fb6eadba2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:32.098593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60411-de0b-4995-913e-a4fb6eadba2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:32.100252 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-30b60411-de0b-4995-913e-a4fb6eadba2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:32.223403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b60411-de0b-4995-913e-a4fb6eadba2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:32.224860 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b60411-de0b-4995-913e-a4fb6eadba2d service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:32.244697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 726/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:34.370757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987de2b-e853-46c2-9f86-e4e3a7be80c2 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:34.371345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987de2b-e853-46c2-9f86-e4e3a7be80c2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:34.371345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987de2b-e853-46c2-9f86-e4e3a7be80c2 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:34.372721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:34.378389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ad6ea-c4f7-4024-95f1-dd37e1d6e949 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:34.378861 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ad6ea-c4f7-4024-95f1-dd37e1d6e949 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:34.378965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ad6ea-c4f7-4024-95f1-dd37e1d6e949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:34.451910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-919ad6ea-c4f7-4024-95f1-dd37e1d6e949 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:34.453046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-919ad6ea-c4f7-4024-95f1-dd37e1d6e949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:34.482946 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:34.551760 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:34.846722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987de2b-e853-46c2-9f86-e4e3a7be80c2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:34.848505 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c987de2b-e853-46c2-9f86-e4e3a7be80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:34.970448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987de2b-e853-46c2-9f86-e4e3a7be80c2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:35.000745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:35.048907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f100d-ecc2-474b-bbeb-614464732c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:35.049531 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f100d-ecc2-474b-bbeb-614464732c23 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:35.049783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f100d-ecc2-474b-bbeb-614464732c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:35.050050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f100d-ecc2-474b-bbeb-614464732c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:35.051696 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-353f100d-ecc2-474b-bbeb-614464732c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:35.168278 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f100d-ecc2-474b-bbeb-614464732c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:35.169648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f100d-ecc2-474b-bbeb-614464732c23 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:35.195503 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 731/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:37.219492 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6036f-2e87-49e8-b4d8-6abda2857399 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.220034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6036f-2e87-49e8-b4d8-6abda2857399 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.220034 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6036f-2e87-49e8-b4d8-6abda2857399 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.221542 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:37.226891 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eedee3-8d38-44c0-bb03-b53fc575f800 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.227345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eedee3-8d38-44c0-bb03-b53fc575f800 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.227467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eedee3-8d38-44c0-bb03-b53fc575f800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.292920 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-00eedee3-8d38-44c0-bb03-b53fc575f800 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:37.294123 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-00eedee3-8d38-44c0-bb03-b53fc575f800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.302344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:37.389218 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:37.675857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6036f-2e87-49e8-b4d8-6abda2857399 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.677395 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-55f6036f-2e87-49e8-b4d8-6abda2857399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.783741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6036f-2e87-49e8-b4d8-6abda2857399 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:37.839523 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:37.858617 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20802c47-72fc-49ac-a634-b2d38e0e9e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:37.859813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802c47-72fc-49ac-a634-b2d38e0e9e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.859813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802c47-72fc-49ac-a634-b2d38e0e9e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.859813 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802c47-72fc-49ac-a634-b2d38e0e9e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.861472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-20802c47-72fc-49ac-a634-b2d38e0e9e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.972300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20802c47-72fc-49ac-a634-b2d38e0e9e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:37.972780 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20802c47-72fc-49ac-a634-b2d38e0e9e26 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:37.991738 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 729/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:39.976639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7045-df32-42b3-a952-1bd7fe0caf8d None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.977159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7045-df32-42b3-a952-1bd7fe0caf8d None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.977159 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7045-df32-42b3-a952-1bd7fe0caf8d None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.978469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:39.984317 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152895a7-33e3-4625-9588-cdf4bd71e0a2 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.984790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152895a7-33e3-4625-9588-cdf4bd71e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.984889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152895a7-33e3-4625-9588-cdf4bd71e0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:40.053396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-152895a7-33e3-4625-9588-cdf4bd71e0a2 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:40.054706 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-152895a7-33e3-4625-9588-cdf4bd71e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:40.095420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:40.155652 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:40.438470 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e7045-df32-42b3-a952-1bd7fe0caf8d None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:40.440149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-672e7045-df32-42b3-a952-1bd7fe0caf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:40.544941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e7045-df32-42b3-a952-1bd7fe0caf8d None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:40.583336 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:40.621351 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bf2fa-eeea-44a9-90df-eda32b7c58dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:40.621955 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bf2fa-eeea-44a9-90df-eda32b7c58dc service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:40.622230 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bf2fa-eeea-44a9-90df-eda32b7c58dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:40.622498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bf2fa-eeea-44a9-90df-eda32b7c58dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:40.624122 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-897bf2fa-eeea-44a9-90df-eda32b7c58dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:40.733252 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bf2fa-eeea-44a9-90df-eda32b7c58dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:40.734620 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bf2fa-eeea-44a9-90df-eda32b7c58dc service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:40.754051 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 734/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:42.749023 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5b1b-cbde-4603-a6ff-b11c3609cf80 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:42.749599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5b1b-cbde-4603-a6ff-b11c3609cf80 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:42.749599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5b1b-cbde-4603-a6ff-b11c3609cf80 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:42.750848 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:42.756343 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741112e-3c0c-499a-8482-680debcaecd8 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:42.756774 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741112e-3c0c-499a-8482-680debcaecd8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:42.756875 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741112e-3c0c-499a-8482-680debcaecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:42.824593 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-0741112e-3c0c-499a-8482-680debcaecd8 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:42.825806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-0741112e-3c0c-499a-8482-680debcaecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:42.844101 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:42.926161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:43.209138 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb5b1b-cbde-4603-a6ff-b11c3609cf80 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:43.210698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-1eeb5b1b-cbde-4603-a6ff-b11c3609cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.316926 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb5b1b-cbde-4603-a6ff-b11c3609cf80 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.385236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:43.392485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea99aa0-eab5-4643-b32b-7c1634f06d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.398948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea99aa0-eab5-4643-b32b-7c1634f06d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.398948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea99aa0-eab5-4643-b32b-7c1634f06d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.398948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea99aa0-eab5-4643-b32b-7c1634f06d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.398948 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-6ea99aa0-eab5-4643-b32b-7c1634f06d3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.508361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea99aa0-eab5-4643-b32b-7c1634f06d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.510415 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea99aa0-eab5-4643-b32b-7c1634f06d3e service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:43.528709 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 732/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:45.453605 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab75f0-c0e6-49ac-8342-357de87a5f7b None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.454181 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab75f0-c0e6-49ac-8342-357de87a5f7b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.454181 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab75f0-c0e6-49ac-8342-357de87a5f7b None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.455505 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:59:45.460786 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927980-cb9a-4c43-8a98-4aef1495cd98 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.461189 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927980-cb9a-4c43-8a98-4aef1495cd98 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.461342 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927980-cb9a-4c43-8a98-4aef1495cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.530644 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-51927980-cb9a-4c43-8a98-4aef1495cd98 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:45.531901 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-51927980-cb9a-4c43-8a98-4aef1495cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:45.581323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:45.631008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:45.912871 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab75f0-c0e6-49ac-8342-357de87a5f7b None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.914396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-0dab75f0-c0e6-49ac-8342-357de87a5f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:46.019850 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab75f0-c0e6-49ac-8342-357de87a5f7b None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:46.068198 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:46.094417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fd1e7-de3b-4210-9797-68827d05dbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:46.095022 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fd1e7-de3b-4210-9797-68827d05dbaf service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:46.095323 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fd1e7-de3b-4210-9797-68827d05dbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:46.095592 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fd1e7-de3b-4210-9797-68827d05dbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:46.097170 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-ff6fd1e7-de3b-4210-9797-68827d05dbaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:46.206187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fd1e7-de3b-4210-9797-68827d05dbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:46.207671 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fd1e7-de3b-4210-9797-68827d05dbaf service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:46.227344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 737/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:55.629112 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=22 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:56.225067 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=66 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:05.942037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f58673-a20e-45f3-8b2f-c9496f74cb5b None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:05.942568 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f58673-a20e-45f3-8b2f-c9496f74cb5b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:05.942568 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f58673-a20e-45f3-8b2f-c9496f74cb5b None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:05.944148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 734/1471] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 01:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:05.950588 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781603-7c4c-416d-86a1-0cdd7328bacd None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:05.951044 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781603-7c4c-416d-86a1-0cdd7328bacd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:05.951168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781603-7c4c-416d-86a1-0cdd7328bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:06.017614 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-7d781603-7c4c-416d-86a1-0cdd7328bacd None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:06.018816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-7d781603-7c4c-416d-86a1-0cdd7328bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:06.113720 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 738/1472] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:06.419971 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf5b0-165a-483a-b7f5-eb41ef8a91e1 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:06.420257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf5b0-165a-483a-b7f5-eb41ef8a91e1 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:06.420535 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf5b0-165a-483a-b7f5-eb41ef8a91e1 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:06.421929 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 735/1473] 10.222.0.58 () {54 vars in 967 bytes} [Sun Aug 28 01:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:06.426795 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ff9a-8bf5-4785-83ea-a1e46d7ba33b None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:06.427076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ff9a-8bf5-4785-83ea-a1e46d7ba33b None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:06.427367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ff9a-8bf5-4785-83ea-a1e46d7ba33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:06.501363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c0a8ff9a-8bf5-4785-83ea-a1e46d7ba33b None None] MFA Rules not processed for user `9bc80df87ba14b3595e171a0e8fd6f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:06.502517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c0a8ff9a-8bf5-4785-83ea-a1e46d7ba33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:06.524054 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:06.579520 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 739/1474] 10.222.0.58 () {58 vars in 1064 bytes} [Sun Aug 28 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:06.587632 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf5b0-165a-483a-b7f5-eb41ef8a91e1 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:06.589120 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ddcdf5b0-165a-483a-b7f5-eb41ef8a91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:06.695058 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf5b0-165a-483a-b7f5-eb41ef8a91e1 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:06.776240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532192f-b467-4ecf-bd0e-cfea8317a760 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc80df87ba14b3595e171a0e8fd6f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:06.776849 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532192f-b467-4ecf-bd0e-cfea8317a760 service glance] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:06.777124 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532192f-b467-4ecf-bd0e-cfea8317a760 service glance] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:06.777396 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532192f-b467-4ecf-bd0e-cfea8317a760 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:06.779006 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8532192f-b467-4ecf-bd0e-cfea8317a760 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:06.835043 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:06.893960 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532192f-b467-4ecf-bd0e-cfea8317a760 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:06.895488 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532192f-b467-4ecf-bd0e-cfea8317a760 service glance] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:06.915931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 736/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:08.930487 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161982a-66ac-4cee-a677-7e2a60626727 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:08.931011 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161982a-66ac-4cee-a677-7e2a60626727 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:08.931152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161982a-66ac-4cee-a677-7e2a60626727 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:08.932530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 740/1476] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 01:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:08.937743 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55347-1b05-4545-ba16-216f83a6395d None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:08.938207 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55347-1b05-4545-ba16-216f83a6395d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:08.938307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55347-1b05-4545-ba16-216f83a6395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.004742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-2bc55347-1b05-4545-ba16-216f83a6395d None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:09.005974 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-2bc55347-1b05-4545-ba16-216f83a6395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:09.104129 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 737/1477] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:09.380433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161982a-66ac-4cee-a677-7e2a60626727 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:09.382041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6161982a-66ac-4cee-a677-7e2a60626727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:09.510208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161982a-66ac-4cee-a677-7e2a60626727 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:09.559038 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:09.604611 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5b015-bb9f-4a8f-b957-023ce5f929a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:09.605251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5b015-bb9f-4a8f-b957-023ce5f929a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:09.605530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5b015-bb9f-4a8f-b957-023ce5f929a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:09.605798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5b015-bb9f-4a8f-b957-023ce5f929a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.606440 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5b015-bb9f-4a8f-b957-023ce5f929a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:09.608229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-c0d5b015-bb9f-4a8f-b957-023ce5f929a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:00:09.608229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:00:09.608229 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:00:09.609383 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5b015-bb9f-4a8f-b957-023ce5f929a5 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:09.630763 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 741/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Sun Aug 28 01:00:09 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:11.559324 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29f54-0681-4a2d-8b00-dd9a1c4e215d None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:11.559856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29f54-0681-4a2d-8b00-dd9a1c4e215d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:11.559856 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29f54-0681-4a2d-8b00-dd9a1c4e215d None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:11.561187 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 738/1479] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 01:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:11.566727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1cba-2c77-46cf-90e0-4b9eed93fcef None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:11.567155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1cba-2c77-46cf-90e0-4b9eed93fcef None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:11.567306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa1cba-2c77-46cf-90e0-4b9eed93fcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:11.635944 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-6daa1cba-2c77-46cf-90e0-4b9eed93fcef None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:11.637152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6daa1cba-2c77-46cf-90e0-4b9eed93fcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:11.736202 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 742/1480] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:12.032257 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29f54-0681-4a2d-8b00-dd9a1c4e215d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:12.033789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-2cf29f54-0681-4a2d-8b00-dd9a1c4e215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:12.044839 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:12.181930 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29f54-0681-4a2d-8b00-dd9a1c4e215d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:12.262661 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:12.296385 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eed63f-17a7-47df-9d1e-4d5f2eee7932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:12.296909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eed63f-17a7-47df-9d1e-4d5f2eee7932 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:12.297183 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eed63f-17a7-47df-9d1e-4d5f2eee7932 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:12.297450 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eed63f-17a7-47df-9d1e-4d5f2eee7932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:12.299031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-15eed63f-17a7-47df-9d1e-4d5f2eee7932 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:12.388370 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eed63f-17a7-47df-9d1e-4d5f2eee7932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:12.389996 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eed63f-17a7-47df-9d1e-4d5f2eee7932 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:12.408892 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 739/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:14.530248 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcc5c6-77b1-4951-9fab-ae5d4e20742a None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:14.530907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcc5c6-77b1-4951-9fab-ae5d4e20742a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:14.530907 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcc5c6-77b1-4951-9fab-ae5d4e20742a None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:14.532187 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 743/1482] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 01:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:14.537605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345cd2-8638-4f08-ac3d-c1260c4e25da None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:14.538011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345cd2-8638-4f08-ac3d-c1260c4e25da None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:14.538158 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345cd2-8638-4f08-ac3d-c1260c4e25da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:14.605291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-45345cd2-8638-4f08-ac3d-c1260c4e25da None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:14.606536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-45345cd2-8638-4f08-ac3d-c1260c4e25da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:14.655072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:14.706967 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 740/1483] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:14.998792 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcc5c6-77b1-4951-9fab-ae5d4e20742a None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:15.000504 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a4bcc5c6-77b1-4951-9fab-ae5d4e20742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:15.024293 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:15.105462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcc5c6-77b1-4951-9fab-ae5d4e20742a None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:15.181526 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5fad2-f781-40a9-bf2d-fe52420e6368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:15.182134 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fad2-f781-40a9-bf2d-fe52420e6368 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:15.182410 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fad2-f781-40a9-bf2d-fe52420e6368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:15.182682 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fad2-f781-40a9-bf2d-fe52420e6368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:15.184325 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2fa5fad2-f781-40a9-bf2d-fe52420e6368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:15.262838 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:15.298842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5fad2-f781-40a9-bf2d-fe52420e6368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:15.300388 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5fad2-f781-40a9-bf2d-fe52420e6368 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:15.319701 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 744/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:17.297367 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459f2e4-f212-49aa-b747-b527ca2ebd3b None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:17.297939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459f2e4-f212-49aa-b747-b527ca2ebd3b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:17.297939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459f2e4-f212-49aa-b747-b527ca2ebd3b None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:17.299307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 741/1485] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 01:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:17.305385 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95db4-2920-4fb4-a16e-69f7e0e0a363 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:17.306024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95db4-2920-4fb4-a16e-69f7e0e0a363 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:17.306024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95db4-2920-4fb4-a16e-69f7e0e0a363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:17.373923 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-8eb95db4-2920-4fb4-a16e-69f7e0e0a363 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:17.375156 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-8eb95db4-2920-4fb4-a16e-69f7e0e0a363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:17.472291 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 745/1486] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:17.774639 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459f2e4-f212-49aa-b747-b527ca2ebd3b None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:17.776210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3459f2e4-f212-49aa-b747-b527ca2ebd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:17.884673 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459f2e4-f212-49aa-b747-b527ca2ebd3b None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:17.956414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:17.958080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa1cc6-6758-4e3f-826a-c6702800f9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:17.958679 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa1cc6-6758-4e3f-826a-c6702800f9fd service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:17.958950 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa1cc6-6758-4e3f-826a-c6702800f9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:17.959245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa1cc6-6758-4e3f-826a-c6702800f9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:17.960824 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3aaa1cc6-6758-4e3f-826a-c6702800f9fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:18.069934 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa1cc6-6758-4e3f-826a-c6702800f9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:18.071541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa1cc6-6758-4e3f-826a-c6702800f9fd service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:18.089420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 742/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:20.102136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae811d9-cbde-4781-a64b-26f30cbb8e5f None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:20.102675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae811d9-cbde-4781-a64b-26f30cbb8e5f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:20.102675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae811d9-cbde-4781-a64b-26f30cbb8e5f None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:20.104106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 746/1488] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 01:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:20.109318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521cba-2320-4c08-ba5f-171488505cac None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:20.109715 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521cba-2320-4c08-ba5f-171488505cac None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:20.109875 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521cba-2320-4c08-ba5f-171488505cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:20.174686 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-97521cba-2320-4c08-ba5f-171488505cac None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:20.175969 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-97521cba-2320-4c08-ba5f-171488505cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:20.228176 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:20.272955 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 743/1489] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:20.565935 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae811d9-cbde-4781-a64b-26f30cbb8e5f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:20.567497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-bae811d9-cbde-4781-a64b-26f30cbb8e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:20.603862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:20.673417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae811d9-cbde-4781-a64b-26f30cbb8e5f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:20.748403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4fccb-11a4-4f67-84b0-0bf0e0545653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:20.748977 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4fccb-11a4-4f67-84b0-0bf0e0545653 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:20.749254 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4fccb-11a4-4f67-84b0-0bf0e0545653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:20.749528 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4fccb-11a4-4f67-84b0-0bf0e0545653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:20.751150 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-13b4fccb-11a4-4f67-84b0-0bf0e0545653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:20.832161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:20.860077 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4fccb-11a4-4f67-84b0-0bf0e0545653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:20.861522 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4fccb-11a4-4f67-84b0-0bf0e0545653 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:20.880729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 747/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:23.353911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7a2b-38fa-4d07-8aba-0a9f315ce5f6 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:23.354480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7a2b-38fa-4d07-8aba-0a9f315ce5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:23.354480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7a2b-38fa-4d07-8aba-0a9f315ce5f6 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:23.355859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 744/1491] 10.222.0.58 () {54 vars in 927 bytes} [Sun Aug 28 01:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:00:23.361456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c194f3f-1d04-457a-8736-ac2f9d9813d3 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:23.361870 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c194f3f-1d04-457a-8736-ac2f9d9813d3 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:23.362002 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c194f3f-1d04-457a-8736-ac2f9d9813d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:23.434580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-8c194f3f-1d04-457a-8736-ac2f9d9813d3 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:23.435853 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-8c194f3f-1d04-457a-8736-ac2f9d9813d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:23.537933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 748/1492] 10.222.0.58 () {58 vars in 1024 bytes} [Sun Aug 28 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:23.847503 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc7a2b-38fa-4d07-8aba-0a9f315ce5f6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:23.850130 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ddfc7a2b-38fa-4d07-8aba-0a9f315ce5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:23.988795 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc7a2b-38fa-4d07-8aba-0a9f315ce5f6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:24.084741 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb07fc-5f7a-402d-acca-061d893bdcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:24.085499 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb07fc-5f7a-402d-acca-061d893bdcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:24.085978 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb07fc-5f7a-402d-acca-061d893bdcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:24.086560 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb07fc-5f7a-402d-acca-061d893bdcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:24.089338 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e1cb07fc-5f7a-402d-acca-061d893bdcb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:24.099797 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:24.221436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb07fc-5f7a-402d-acca-061d893bdcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:24.222898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb07fc-5f7a-402d-acca-061d893bdcb0 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:24.244956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 745/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:33.535689 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=82 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:34.241490 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=50 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:10.724466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.725060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.725060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.814632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:10.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:10.926827 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 749/1494] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:10.935012 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f829e8-169f-4164-90a5-3904773dc02b None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:10.935568 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f829e8-169f-4164-90a5-3904773dc02b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:10.935674 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f829e8-169f-4164-90a5-3904773dc02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.025917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-06f829e8-169f-4164-90a5-3904773dc02b None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:11.027191 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-06f829e8-169f-4164-90a5-3904773dc02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:11.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 746/1495] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:11.138157 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:11.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:11.151980 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ff370-3c98-4944-9833-1b7b4f9fbc74 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:11.157829 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:11.158445 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.158745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.159013 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.159695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:02:11.159993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:11.161003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:11.161003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:02:11.161003 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:02:11.161887 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:11.175822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 750/1496] 10.222.0.58 () {58 vars in 1153 bytes} [Sun Aug 28 01:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:02:11.184045 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f829e8-169f-4164-90a5-3904773dc02b None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:11.194645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f829e8-169f-4164-90a5-3904773dc02b None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:11.211376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:11.211995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.212275 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.212547 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.213194 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:11.214991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING py.warnings [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:11.214991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: warnings.warn(msg) Aug 28 01:02:11.214991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: Aug 28 01:02:11.216305 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:11.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 747/1497] 10.222.0.58 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:11 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:11.332434 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:11.344522 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a92c-efc0-45fd-951d-0b056dd42a6c admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:11.397135 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:11.403942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:11.408448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.408448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.408448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.408448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:11.408448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:11.408448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:02:11.408448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:02:11.409076 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:11.515566 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 751/1498] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:11 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:02:11.519857 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:11.531241 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b037-e971-4359-a230-8ac61e2d02b0 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:11.536251 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:11.536893 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.537173 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.537448 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.538096 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:11.539128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING py.warnings [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:11.539128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: warnings.warn(msg) Aug 28 01:02:11.539128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: Aug 28 01:02:11.540021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:11.554493 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 748/1499] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:11.559848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:11.570256 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9f00-ca5c-45ee-abac-d5bcf7bdc4d3 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:11.574853 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c50cd-5bdc-46ec-80a5-90c83098835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:11.575481 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c50cd-5bdc-46ec-80a5-90c83098835a admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.575759 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c50cd-5bdc-46ec-80a5-90c83098835a admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.576032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c50cd-5bdc-46ec-80a5-90c83098835a admin admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.576676 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c50cd-5bdc-46ec-80a5-90c83098835a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:11.578698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-525c50cd-5bdc-46ec-80a5-90c83098835a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:11.578698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:02:11.578698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:02:11.579692 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c50cd-5bdc-46ec-80a5-90c83098835a admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:11.593750 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 752/1500] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:11.598051 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:11.608678 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adcfec-ab5b-40db-a328-2f0cf6d2b094 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:11.613399 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fe449-e2f2-455c-a7ed-ea7e50967d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:11.614044 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe449-e2f2-455c-a7ed-ea7e50967d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.614322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe449-e2f2-455c-a7ed-ea7e50967d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.614593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe449-e2f2-455c-a7ed-ea7e50967d8a admin admin] PATH_INFO: `/v3/projects/2d887781d36e44abb8f530a5e326a23c/users/6d346cab51b9437d90913a044454d49a/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.628991 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fe449-e2f2-455c-a7ed-ea7e50967d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d887781d36e44abb8f530a5e326a23c, user_id=6d346cab51b9437d90913a044454d49a, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:11.630012 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING py.warnings [None req-e25fe449-e2f2-455c-a7ed-ea7e50967d8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:11.630012 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: warnings.warn(msg) Aug 28 01:02:11.630012 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: Aug 28 01:02:11.631976 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fe449-e2f2-455c-a7ed-ea7e50967d8a admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:11.634143 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:11.749362 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 749/1501] 10.222.0.58 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:11 2022] PUT /identity/v3/projects/2d887781d36e44abb8f530a5e326a23c/users/6d346cab51b9437d90913a044454d49a/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:11.761890 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc707f-4d07-408c-98e1-e1f0e2aa3ec1 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.770433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc707f-4d07-408c-98e1-e1f0e2aa3ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.770433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc707f-4d07-408c-98e1-e1f0e2aa3ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.791456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-2cfc707f-4d07-408c-98e1-e1f0e2aa3ec1 None None] MFA Rules not processed for user `6d346cab51b9437d90913a044454d49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:11.792665 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-2cfc707f-4d07-408c-98e1-e1f0e2aa3ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:11.860573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 753/1502] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:11.873713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14d2e-78d0-45cf-b918-f949c798010b None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.874008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14d2e-78d0-45cf-b918-f949c798010b None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.874295 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14d2e-78d0-45cf-b918-f949c798010b None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.875714 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 750/1503] 10.222.0.58 () {54 vars in 964 bytes} [Sun Aug 28 01:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:11.880598 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382796-e3ad-4b84-be8e-0b8d00ddb5f0 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:11.880885 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382796-e3ad-4b84-be8e-0b8d00ddb5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:11.881162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382796-e3ad-4b84-be8e-0b8d00ddb5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:11.941499 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-30382796-e3ad-4b84-be8e-0b8d00ddb5f0 None None] MFA Rules not processed for user `c481bcb02495453f806fdc6a9d30ed58`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:11.942709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-30382796-e3ad-4b84-be8e-0b8d00ddb5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:12.017705 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 754/1504] 10.222.0.58 () {58 vars in 1061 bytes} [Sun Aug 28 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:12.025468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14d2e-78d0-45cf-b918-f949c798010b None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:12.036424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14d2e-78d0-45cf-b918-f949c798010b None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:12.040030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c481bcb02495453f806fdc6a9d30ed58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:12.040619 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:12.040898 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:12.041201 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:12.050341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:12.051796 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:12.061536 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 751/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:12.107037 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc39989-cb59-4fa1-b257-c94785acc591 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:12.107348 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc39989-cb59-4fa1-b257-c94785acc591 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:12.107619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc39989-cb59-4fa1-b257-c94785acc591 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:12.109770 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 755/1506] 10.222.0.58 () {52 vars in 830 bytes} [Sun Aug 28 01:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:12.113407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:12.184985 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e23d2-ea9c-4fac-8ff9-2c59177be21c service cinder] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:12.190635 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:12.191313 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:12.191641 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:12.191918 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] PATH_INFO: `/v3/users/6d346cab51b9437d90913a044454d49a` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:12.193138 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d346cab51b9437d90913a044454d49a)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:12.194434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING py.warnings [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:12.194434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: warnings.warn(msg) Aug 28 01:02:12.194434 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: Aug 28 01:02:12.195692 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:12.395219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d346cab51b9437d90913a044454d49a'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:12.410263 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d346cab51b9437d90913a044454d49a'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:12.439235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d346cab51b9437d90913a044454d49a'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:12.440122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d346cab51b9437d90913a044454d49a'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:12.440744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d346cab51b9437d90913a044454d49a'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:12.520869 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 752/1507] 10.222.0.58 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:12 2022] DELETE /identity/v3/users/6d346cab51b9437d90913a044454d49a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:12.525421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:12.525773 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:12.526110 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:12.546253 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:12.547453 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:12.557242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:12.607946 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 756/1508] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:12.617640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:12.619116 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:12.807080 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:12.820726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acf2d3-5cbb-4dd6-a3e2-8779337cfb8e admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:12.824381 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82756a19-5479-40fb-8682-2add20d9d325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:12.824992 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82756a19-5479-40fb-8682-2add20d9d325 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:12.825270 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82756a19-5479-40fb-8682-2add20d9d325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:12.825538 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82756a19-5479-40fb-8682-2add20d9d325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:12.835126 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82756a19-5479-40fb-8682-2add20d9d325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:12.836557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82756a19-5479-40fb-8682-2add20d9d325 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:12.846586 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 753/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:13.305251 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:13.306800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:13.319565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbdad-6e2d-4dcc-a58f-91c17c728266 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:13.324597 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:13.325506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:13.325506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:13.325755 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] PATH_INFO: `/v3/projects/2d887781d36e44abb8f530a5e326a23c` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:13.327516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d887781d36e44abb8f530a5e326a23c)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:13.328749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:02:13.328749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:02:13.328749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:02:13.330032 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:13.435927 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d887781d36e44abb8f530a5e326a23c', 'request_id': 'req-789b16ca-6dcc-4db5-aaa8-d15809312144'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:13.450705 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d887781d36e44abb8f530a5e326a23c', 'request_id': 'req-789b16ca-6dcc-4db5-aaa8-d15809312144'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:13.457563 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d887781d36e44abb8f530a5e326a23c', 'request_id': 'req-789b16ca-6dcc-4db5-aaa8-d15809312144'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:13.515036 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] The token cache is being invalidate because project 2d887781d36e44abb8f530a5e326a23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:13.515357 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:13.516228 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-789b16ca-6dcc-4db5-aaa8-d15809312144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:13.517782 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 757/1510] 10.222.0.58 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:13 2022] DELETE /identity/v3/projects/2d887781d36e44abb8f530a5e326a23c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:22.879369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=8 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:23.510735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:30.315483 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718292e-0953-41c4-a8a2-4c014167a1bb None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:30.316087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718292e-0953-41c4-a8a2-4c014167a1bb None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:30.316087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718292e-0953-41c4-a8a2-4c014167a1bb None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:30.317300 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:30.322455 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b2344-cd10-48d8-af45-1c6844463a97 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:30.322976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b2344-cd10-48d8-af45-1c6844463a97 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:30.322976 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b2344-cd10-48d8-af45-1c6844463a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:30.343353 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a27b2344-cd10-48d8-af45-1c6844463a97 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:30.344579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a27b2344-cd10-48d8-af45-1c6844463a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:30.404575 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:30.560375 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718292e-0953-41c4-a8a2-4c014167a1bb None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:30.562077 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-2718292e-0953-41c4-a8a2-4c014167a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:30.675347 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718292e-0953-41c4-a8a2-4c014167a1bb None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:30.680985 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc15bd6-1ca0-4a00-8879-4b1be835155a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:30.681593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc15bd6-1ca0-4a00-8879-4b1be835155a service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:30.681870 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc15bd6-1ca0-4a00-8879-4b1be835155a service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:30.682142 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc15bd6-1ca0-4a00-8879-4b1be835155a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:30.690979 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc15bd6-1ca0-4a00-8879-4b1be835155a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:30.692627 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc15bd6-1ca0-4a00-8879-4b1be835155a service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:30.704036 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 755/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:31.598840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179b0be-3c96-4bcf-a9b1-8dcc519da856 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:31.599448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179b0be-3c96-4bcf-a9b1-8dcc519da856 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:31.599448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179b0be-3c96-4bcf-a9b1-8dcc519da856 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:31.600839 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:31.608314 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaf42d-684a-4569-8afe-817f81ef22ef None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:31.609027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaf42d-684a-4569-8afe-817f81ef22ef None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:31.609027 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaf42d-684a-4569-8afe-817f81ef22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:31.631253 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-0bdaf42d-684a-4569-8afe-817f81ef22ef None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:31.633007 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-0bdaf42d-684a-4569-8afe-817f81ef22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:31.643087 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:31.803911 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179b0be-3c96-4bcf-a9b1-8dcc519da856 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:31.820065 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179b0be-3c96-4bcf-a9b1-8dcc519da856 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:31.826842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f40ee-d390-4ffb-909d-d2f412c76f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:31.827500 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f40ee-d390-4ffb-909d-d2f412c76f75 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:31.827778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f40ee-d390-4ffb-909d-d2f412c76f75 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:31.828059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f40ee-d390-4ffb-909d-d2f412c76f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:31.837340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f40ee-d390-4ffb-909d-d2f412c76f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:31.838971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f40ee-d390-4ffb-909d-d2f412c76f75 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:31.849922 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 760/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:34.795917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c1152-2841-4996-96cd-094679cd4842 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.796494 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c1152-2841-4996-96cd-094679cd4842 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.796494 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c1152-2841-4996-96cd-094679cd4842 None None] PATH_INFO: `/v3` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.797755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 757/1517] 10.222.0.61 () {54 vars in 925 bytes} [Sun Aug 28 01:03:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:03:34.804227 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0a48-b052-4de1-a061-9e197cecbc6a None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.804716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0a48-b052-4de1-a061-9e197cecbc6a None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.804879 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0a48-b052-4de1-a061-9e197cecbc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.863804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-101c0a48-b052-4de1-a061-9e197cecbc6a None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:34.865060 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-101c0a48-b052-4de1-a061-9e197cecbc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:34.950523 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 761/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Sun Aug 28 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:41.625717 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=49 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:43.177877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e985e9-4dca-478b-9c44-ede2fa966e89 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.178648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e985e9-4dca-478b-9c44-ede2fa966e89 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.178648 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e985e9-4dca-478b-9c44-ede2fa966e89 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.179874 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 758/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:43.187320 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316496-0c71-4fcb-a725-6baf5eba0731 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.187962 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316496-0c71-4fcb-a725-6baf5eba0731 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.188469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316496-0c71-4fcb-a725-6baf5eba0731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.222497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-54316496-0c71-4fcb-a725-6baf5eba0731 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:43.223899 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-54316496-0c71-4fcb-a725-6baf5eba0731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:43.233179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 762/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:43.393940 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e985e9-4dca-478b-9c44-ede2fa966e89 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:43.409912 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e985e9-4dca-478b-9c44-ede2fa966e89 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:43.415770 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f3abd-dc36-4cc8-9f5b-88592d64a9f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:43.416389 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f3abd-dc36-4cc8-9f5b-88592d64a9f1 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.416693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f3abd-dc36-4cc8-9f5b-88592d64a9f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.416931 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f3abd-dc36-4cc8-9f5b-88592d64a9f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.427452 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f3abd-dc36-4cc8-9f5b-88592d64a9f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:43.430369 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f3abd-dc36-4cc8-9f5b-88592d64a9f1 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:43.441742 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 759/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:44.089893 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ecfe-d752-46fc-a241-9b03ff1da606 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.090417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ecfe-d752-46fc-a241-9b03ff1da606 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.090791 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ecfe-d752-46fc-a241-9b03ff1da606 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.092314 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 763/1522] 10.222.0.58 () {54 vars in 961 bytes} [Sun Aug 28 01:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:44.098942 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae32d-894d-4a3b-a35c-d632b3ab4836 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.099484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae32d-894d-4a3b-a35c-d632b3ab4836 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.099993 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae32d-894d-4a3b-a35c-d632b3ab4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.133652 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-26bae32d-894d-4a3b-a35c-d632b3ab4836 None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:44.135753 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-26bae32d-894d-4a3b-a35c-d632b3ab4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:44.149343 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 760/1523] 10.222.0.58 () {58 vars in 1058 bytes} [Sun Aug 28 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:44.159054 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ecfe-d752-46fc-a241-9b03ff1da606 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:44.180274 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ecfe-d752-46fc-a241-9b03ff1da606 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:44.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20208dd-1d59-4bd4-a11c-6b5328a26f22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71de6ef4ed504cfe8289c8ec519405bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:44.189190 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20208dd-1d59-4bd4-a11c-6b5328a26f22 service placement] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.190006 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20208dd-1d59-4bd4-a11c-6b5328a26f22 service placement] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.190562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20208dd-1d59-4bd4-a11c-6b5328a26f22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.206565 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20208dd-1d59-4bd4-a11c-6b5328a26f22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:44.209611 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20208dd-1d59-4bd4-a11c-6b5328a26f22 service placement] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:44.228239 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 764/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:44.393532 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688324a-d475-4771-bd71-981205acfe5a None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.394339 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688324a-d475-4771-bd71-981205acfe5a None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.394528 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688324a-d475-4771-bd71-981205acfe5a None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.397377 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:03:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:44.405343 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980048-d48d-4f2a-b972-c41eac65bdfe None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.405656 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980048-d48d-4f2a-b972-c41eac65bdfe None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.406057 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980048-d48d-4f2a-b972-c41eac65bdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.435042 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-1e980048-d48d-4f2a-b972-c41eac65bdfe None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:44.436307 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-1e980048-d48d-4f2a-b972-c41eac65bdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:44.448970 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:44.738920 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688324a-d475-4771-bd71-981205acfe5a None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:44.764386 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688324a-d475-4771-bd71-981205acfe5a None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:44.771906 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e66970-c73a-4456-9a2a-d3d6028873f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:44.772626 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66970-c73a-4456-9a2a-d3d6028873f5 service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.772973 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66970-c73a-4456-9a2a-d3d6028873f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.773293 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66970-c73a-4456-9a2a-d3d6028873f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.783266 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e66970-c73a-4456-9a2a-d3d6028873f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:44.784895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e66970-c73a-4456-9a2a-d3d6028873f5 service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:44.797099 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 762/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:48.678028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b47364-7cc2-4b09-a183-2d097d1b7ac2 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:48.678533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b47364-7cc2-4b09-a183-2d097d1b7ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:48.690758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b47364-7cc2-4b09-a183-2d097d1b7ac2 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:48.690758 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:03:48.691072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74308-7c4c-40dd-977e-df745ccd5514 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:48.691072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74308-7c4c-40dd-977e-df745ccd5514 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:48.691072 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74308-7c4c-40dd-977e-df745ccd5514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:48.707841 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c3b74308-7c4c-40dd-977e-df745ccd5514 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:48.709066 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c3b74308-7c4c-40dd-977e-df745ccd5514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:48.717884 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:49.009723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b47364-7cc2-4b09-a183-2d097d1b7ac2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:49.012217 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-13b47364-7cc2-4b09-a183-2d097d1b7ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:49.045514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=100 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:49.083870 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b47364-7cc2-4b09-a183-2d097d1b7ac2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:49.088822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1220be8-6268-460f-9020-997f102fdc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:49.089803 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220be8-6268-460f-9020-997f102fdc15 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:49.090201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220be8-6268-460f-9020-997f102fdc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:49.090674 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220be8-6268-460f-9020-997f102fdc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:49.102281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1220be8-6268-460f-9020-997f102fdc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:49.104012 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1220be8-6268-460f-9020-997f102fdc15 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:49.115904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 767/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:03:51.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249510b-1642-4a97-a491-d98c4537875d None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:51.150316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249510b-1642-4a97-a491-d98c4537875d None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:51.150316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249510b-1642-4a97-a491-d98c4537875d None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:51.152135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:51.158146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b5370-1067-438c-997b-542cb45e8d18 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:51.158668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b5370-1067-438c-997b-542cb45e8d18 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:51.158774 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b5370-1067-438c-997b-542cb45e8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:51.179573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-e97b5370-1067-438c-997b-542cb45e8d18 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:51.180796 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-e97b5370-1067-438c-997b-542cb45e8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:51.189992 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:51.482711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249510b-1642-4a97-a491-d98c4537875d None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:51.484737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-5249510b-1642-4a97-a491-d98c4537875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:51.498109 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249510b-1642-4a97-a491-d98c4537875d None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:51.501709 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef9acd-958c-4de9-ae4e-0d1c408a13d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:51.502316 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef9acd-958c-4de9-ae4e-0d1c408a13d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:51.502593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef9acd-958c-4de9-ae4e-0d1c408a13d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:51.502864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef9acd-958c-4de9-ae4e-0d1c408a13d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:51.513022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef9acd-958c-4de9-ae4e-0d1c408a13d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:51.514461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef9acd-958c-4de9-ae4e-0d1c408a13d0 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:51.524747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 765/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:54.870724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3e76-5099-4da9-9e0c-06bcc9d2f529 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:54.871328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3e76-5099-4da9-9e0c-06bcc9d2f529 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:54.871328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a3e76-5099-4da9-9e0c-06bcc9d2f529 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:54.872903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:54.879030 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e12a-d5fe-47aa-ae31-8bf8e8f2593e None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:54.879580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e12a-d5fe-47aa-ae31-8bf8e8f2593e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:54.879580 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e12a-d5fe-47aa-ae31-8bf8e8f2593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:54.899477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3ff8e12a-d5fe-47aa-ae31-8bf8e8f2593e None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:54.900693 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3ff8e12a-d5fe-47aa-ae31-8bf8e8f2593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:54.909309 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:55.475628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3e76-5099-4da9-9e0c-06bcc9d2f529 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:55.477344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a95a3e76-5099-4da9-9e0c-06bcc9d2f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:55.542839 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a3e76-5099-4da9-9e0c-06bcc9d2f529 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:55.546707 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2c864-9414-43fa-9e69-891d84f549ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c481bcb02495453f806fdc6a9d30ed58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:55.547367 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c864-9414-43fa-9e69-891d84f549ed service cinder] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:55.547649 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c864-9414-43fa-9e69-891d84f549ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:55.547921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c864-9414-43fa-9e69-891d84f549ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:55.558660 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2c864-9414-43fa-9e69-891d84f549ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:55.560270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2c864-9414-43fa-9e69-891d84f549ed service cinder] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:55.571143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 770/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:57.593540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5da3-72e6-442e-96fe-7552b6583990 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:57.594113 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5da3-72e6-442e-96fe-7552b6583990 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:57.594208 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5da3-72e6-442e-96fe-7552b6583990 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:57.595701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:57.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f06c-b12d-4e54-8d9b-05f261466a5f None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:57.602103 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f06c-b12d-4e54-8d9b-05f261466a5f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:57.602233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f06c-b12d-4e54-8d9b-05f261466a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:57.623441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-85d3f06c-b12d-4e54-8d9b-05f261466a5f None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:57.624658 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-85d3f06c-b12d-4e54-8d9b-05f261466a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:57.632737 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:58.203402 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db5da3-72e6-442e-96fe-7552b6583990 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:58.205944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-88db5da3-72e6-442e-96fe-7552b6583990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:58.223387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db5da3-72e6-442e-96fe-7552b6583990 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:58.227137 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4dd26-9cb6-400a-b652-7217d4017c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c481bcb02495453f806fdc6a9d30ed58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:58.227808 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4dd26-9cb6-400a-b652-7217d4017c1f service cinder] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:58.228097 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4dd26-9cb6-400a-b652-7217d4017c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:58.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4dd26-9cb6-400a-b652-7217d4017c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:58.238905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4dd26-9cb6-400a-b652-7217d4017c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:58.240366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4dd26-9cb6-400a-b652-7217d4017c1f service cinder] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:58.251576 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 768/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:04:07.617260 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=47 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:08.246748 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=33 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:16.086733 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695af05c-1951-40db-8694-7f7d9075b7bb None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.087363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695af05c-1951-40db-8694-7f7d9075b7bb None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.087363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695af05c-1951-40db-8694-7f7d9075b7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.092933 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c6592-e0e0-44e3-8148-4d05200996d7 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.093387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c6592-e0e0-44e3-8148-4d05200996d7 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.093484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c6592-e0e0-44e3-8148-4d05200996d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.107442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-695af05c-1951-40db-8694-7f7d9075b7bb None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.108648 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-695af05c-1951-40db-8694-7f7d9075b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.113559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-bd9c6592-e0e0-44e3-8148-4d05200996d7 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.114731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-bd9c6592-e0e0-44e3-8148-4d05200996d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.116941 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 772/1540] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:16.123197 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 769/1541] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:16.125329 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec02aab-0dd7-4fe7-bdc7-3c1064d278bd None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.125610 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec02aab-0dd7-4fe7-bdc7-3c1064d278bd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.125884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec02aab-0dd7-4fe7-bdc7-3c1064d278bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.131220 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7e591-c3f3-43af-a70b-de2c86fe7e07 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.131512 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7e591-c3f3-43af-a70b-de2c86fe7e07 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7e591-c3f3-43af-a70b-de2c86fe7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.146379 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-cec02aab-0dd7-4fe7-bdc7-3c1064d278bd None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.148164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-cec02aab-0dd7-4fe7-bdc7-3c1064d278bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.151645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-aeb7e591-c3f3-43af-a70b-de2c86fe7e07 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.152828 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-aeb7e591-c3f3-43af-a70b-de2c86fe7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.156630 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 773/1542] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:16.161013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 770/1543] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:16.161340 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec02aab-0dd7-4fe7-bdc7-3c1064d278bd None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.166390 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7e591-c3f3-43af-a70b-de2c86fe7e07 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.172279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec02aab-0dd7-4fe7-bdc7-3c1064d278bd None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.175868 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7e591-c3f3-43af-a70b-de2c86fe7e07 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.176934 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.177535 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.177807 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.178143 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] PATH_INFO: `/v3/domains` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.178806 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:05:16.179124 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.180746 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.181071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.181679 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.181959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.182436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.183086 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:05:16.183945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.184956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING py.warnings [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:05:16.184956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: warnings.warn(msg) Aug 28 01:05:16.184956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: Aug 28 01:05:16.186098 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.200225 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 774/1544] 10.222.0.58 () {58 vars in 1153 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:05:16.200440 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 771/1545] 10.222.0.58 () {58 vars in 1153 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:05:16.201739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.206499 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.212431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0df43-14f8-4794-9ad8-02f8935f4371 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.217194 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.217731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b09e5-8cfd-43ec-a817-27d038728e91 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.217852 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.218050 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.218379 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.218952 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.219986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:05:16.219986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:05:16.219986 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:05:16.221182 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.222594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.223216 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.223504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.223780 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.224397 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.227128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.324078 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 775/1546] 10.222.0.58 () {60 vars in 1153 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:16.328255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.354009 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 772/1547] 10.222.0.58 () {60 vars in 1153 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:16.358019 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.395006 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b56c-f895-419e-8c2a-33639a74c7b2 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.426407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b19e69-226a-4b5e-bd45-cd541d976d63 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.432122 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.432749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.433038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.433311 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.433984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.435013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING py.warnings [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:05:16.435013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: warnings.warn(msg) Aug 28 01:05:16.435013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: Aug 28 01:05:16.436529 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.458491 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.459151 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.459460 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.459734 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] PATH_INFO: `/v3/users` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.460386 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.462328 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.567180 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 773/1548] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:16.568598 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.577655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 776/1549] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:16.578804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.579430 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d710-6ff7-40d2-bfa8-b45e0db04646 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.586504 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.587188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.587436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.587711 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.588416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.589739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f00df-cfcf-4dff-81e2-1483d7448317 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.590018 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.595310 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.596047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.597259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.597259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.597431 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.598990 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.601877 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 774/1550] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:16.605928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.613070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 777/1551] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:16.614374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.619226 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db94c9-5375-4eab-9b3f-fa5f7c190901 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.624778 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2acc8-6332-4911-8938-e3c51adf9857 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.624957 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.625423 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.625698 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.625965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.626624 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.628379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.629625 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.630218 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.630495 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.630767 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.632052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.633627 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.639744 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 775/1552] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:16.643788 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.651764 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 778/1553] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:16.654620 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ede1d-7861-4e11-a015-c32bade73be2 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.654854 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.659431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55e660-d16d-4aab-9ff7-00f02434ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.660090 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e660-d16d-4aab-9ff7-00f02434ac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.660459 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e660-d16d-4aab-9ff7-00f02434ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.660798 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e660-d16d-4aab-9ff7-00f02434ac99 admin admin] PATH_INFO: `/v3/projects/0be0d4807eb64cefa75cd93552992435/users/c2ace0b690a94582811ea593384f6b0f/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.665577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c2403-239e-4ec6-bdc2-6bd92c9f9050 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.671270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef1fb-8814-442d-bd67-360b855b117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef1fb-8814-442d-bd67-360b855b117d admin admin] REQUEST_METHOD: `PUT` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.672350 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef1fb-8814-442d-bd67-360b855b117d admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.672624 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef1fb-8814-442d-bd67-360b855b117d admin admin] PATH_INFO: `/v3/projects/f26060ecd8944d90a9c8529d352699ec/users/b1b39b1f1d6c4e34a8c56c31ced3d50b/roles/70eb8f7fc9b340d3a20422a2225491fd` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.678595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55e660-d16d-4aab-9ff7-00f02434ac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be0d4807eb64cefa75cd93552992435, user_id=c2ace0b690a94582811ea593384f6b0f, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.681273 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55e660-d16d-4aab-9ff7-00f02434ac99 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.689474 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef1fb-8814-442d-bd67-360b855b117d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26060ecd8944d90a9c8529d352699ec, user_id=b1b39b1f1d6c4e34a8c56c31ced3d50b, role_id=70eb8f7fc9b340d3a20422a2225491fd)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.690507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-e7eef1fb-8814-442d-bd67-360b855b117d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:05:16.690507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:05:16.690507 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:05:16.692482 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef1fb-8814-442d-bd67-360b855b117d admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.758754 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 776/1554] 10.222.0.58 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:16 2022] PUT /identity/v3/projects/0be0d4807eb64cefa75cd93552992435/users/c2ace0b690a94582811ea593384f6b0f/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:05:16.764407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464018a-ef9c-4187-a5de-393ad5623aa6 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.764684 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464018a-ef9c-4187-a5de-393ad5623aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.764954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464018a-ef9c-4187-a5de-393ad5623aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.785811 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-a464018a-ef9c-4187-a5de-393ad5623aa6 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.787029 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-a464018a-ef9c-4187-a5de-393ad5623aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.835235 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:16.842687 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 779/1555] 10.222.0.58 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:16 2022] PUT /identity/v3/projects/f26060ecd8944d90a9c8529d352699ec/users/b1b39b1f1d6c4e34a8c56c31ced3d50b/roles/70eb8f7fc9b340d3a20422a2225491fd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:16.848374 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 777/1556] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:16.853398 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1696-0c71-4729-9c3d-61ffbf79d042 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.853690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1696-0c71-4729-9c3d-61ffbf79d042 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.853971 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1696-0c71-4729-9c3d-61ffbf79d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.859060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464018a-ef9c-4187-a5de-393ad5623aa6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.861435 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:16.873902 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a7ea1696-0c71-4729-9c3d-61ffbf79d042 None None] MFA Rules not processed for user `00caaefe5f7440c9962342f8ae00dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.875167 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a7ea1696-0c71-4729-9c3d-61ffbf79d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.917186 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464018a-ef9c-4187-a5de-393ad5623aa6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.939577 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 780/1557] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:16.949397 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1696-0c71-4729-9c3d-61ffbf79d042 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.967378 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a462dc-0053-4d1f-aa5a-7a3508ebe8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.967939 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a462dc-0053-4d1f-aa5a-7a3508ebe8ef service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.968219 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a462dc-0053-4d1f-aa5a-7a3508ebe8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.968485 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a462dc-0053-4d1f-aa5a-7a3508ebe8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.978649 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a462dc-0053-4d1f-aa5a-7a3508ebe8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.980137 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a462dc-0053-4d1f-aa5a-7a3508ebe8ef service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.990035 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 778/1558] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:05:17.007646 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1696-0c71-4729-9c3d-61ffbf79d042 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:17.011534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:17.012180 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.012475 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.012749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.023175 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:17.024646 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:17.034908 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 781/1559] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:05:24.157060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8cb0-475b-4cf8-8e3e-5cd3a4bc333e None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.158008 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8cb0-475b-4cf8-8e3e-5cd3a4bc333e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.158461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8cb0-475b-4cf8-8e3e-5cd3a4bc333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.192739 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-1c8b8cb0-475b-4cf8-8e3e-5cd3a4bc333e None None] MFA Rules not processed for user `b1b39b1f1d6c4e34a8c56c31ced3d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:24.194772 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-1c8b8cb0-475b-4cf8-8e3e-5cd3a4bc333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:24.279199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 779/1560] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:24.280387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:24.292867 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a4c10-93b3-4b1b-bc21-d32678b98e23 service neutron] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:24.299313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:24.300070 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.300345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.300634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.305308 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:24.307292 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:24.395805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 782/1561] 10.222.0.58 () {60 vars in 1153 bytes} [Sun Aug 28 01:05:24 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:24.400022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8cb0-475b-4cf8-8e3e-5cd3a4bc333e None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:24.415721 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8cb0-475b-4cf8-8e3e-5cd3a4bc333e None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:24.515433 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=100 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:24.552013 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:24.552763 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.553223 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.553510 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.554281 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:24.558774 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:24.667816 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 780/1562] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 01:05:24 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:24.671921 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:24.684072 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc10baf-2943-4bf9-8921-533242e91304 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:24.689168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60eab8-a630-449b-8e9c-250ef9066ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:24.692106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60eab8-a630-449b-8e9c-250ef9066ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.692106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60eab8-a630-449b-8e9c-250ef9066ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.692106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60eab8-a630-449b-8e9c-250ef9066ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.692106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60eab8-a630-449b-8e9c-250ef9066ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:24.693106 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60eab8-a630-449b-8e9c-250ef9066ed1 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:24.705523 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 783/1563] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:05:24.709548 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:24.725199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3419e-114b-416d-8aaf-d2b1b29b2b16 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:24.731002 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:24.731965 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.732414 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.732859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] PATH_INFO: `/v3/projects/cd267ebdfbc148eb82f27a519bd251fd/users/a927ac169bb948cebf51e9d4089e3eec/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.752011 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd267ebdfbc148eb82f27a519bd251fd, user_id=a927ac169bb948cebf51e9d4089e3eec, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:24.755431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:24.799201 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff0121-4aca-45bf-a545-982eed578b1f None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.799456 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff0121-4aca-45bf-a545-982eed578b1f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.799728 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff0121-4aca-45bf-a545-982eed578b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.833021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 781/1564] 10.222.0.58 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:24 2022] PUT /identity/v3/projects/cd267ebdfbc148eb82f27a519bd251fd/users/a927ac169bb948cebf51e9d4089e3eec/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:24.836112 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-59ff0121-4aca-45bf-a545-982eed578b1f None None] MFA Rules not processed for user `c2ace0b690a94582811ea593384f6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:24.838448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-59ff0121-4aca-45bf-a545-982eed578b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:24.840523 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:24.933480 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc234c1-8f3e-4b52-b66e-d04b51a16734 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:24.941779 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:24.942568 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.942755 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.942984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.943747 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:24.945549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:24.951085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 784/1565] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:24.956179 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff0121-4aca-45bf-a545-982eed578b1f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:24.963781 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:24.964984 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 782/1566] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:24.968858 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:24.975439 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff0121-4aca-45bf-a545-982eed578b1f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:24.977646 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.978712 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.979049 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.979801 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:24.982218 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:24.983500 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc42695-5139-4e8d-845e-5b1c446ee811 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:24.992540 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:24.993441 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:24.993791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:24.994682 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] PATH_INFO: `/v3/projects/cd267ebdfbc148eb82f27a519bd251fd/users/a927ac169bb948cebf51e9d4089e3eec/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:24.997681 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd267ebdfbc148eb82f27a519bd251fd, user_id=a927ac169bb948cebf51e9d4089e3eec, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:25.001336 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:25.015541 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 783/1567] 10.222.0.58 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:24 2022] PUT /identity/v3/projects/cd267ebdfbc148eb82f27a519bd251fd/users/a927ac169bb948cebf51e9d4089e3eec/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:25.059149 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 785/1568] 10.222.0.58 () {60 vars in 1153 bytes} [Sun Aug 28 01:05:24 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:25.065766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:25.142794 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02ee1-6691-4444-8deb-b90a30a16028 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:25.188038 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:25.209552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:25.210188 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:25.210495 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:25.210767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] PATH_INFO: `/v3/users` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:25.211567 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:25.213595 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:25.305911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 784/1569] 10.222.0.58 () {60 vars in 1144 bytes} [Sun Aug 28 01:05:25 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:05:25.310207 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:25.322366 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13b028-6324-40d8-9a63-cde35e8fc927 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:25.327246 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:25.328203 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:25.328485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:25.328761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:25.329442 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:25.335412 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:25.350321 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 786/1570] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:25.351673 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:25.366199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f936d2-71c8-4776-85fa-085aa7f76683 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:25.371291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:25.371994 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:25.372247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:25.372515 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] PATH_INFO: `/v3/projects/87bfeb6b4cfd4b9fab241d880cf5b2cc/users/ea77d77ff7cb47e3869757b73100baf0/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:25.391332 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bfeb6b4cfd4b9fab241d880cf5b2cc, user_id=ea77d77ff7cb47e3869757b73100baf0, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:25.394148 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:25.471642 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 785/1571] 10.222.0.58 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:25 2022] PUT /identity/v3/projects/87bfeb6b4cfd4b9fab241d880cf5b2cc/users/ea77d77ff7cb47e3869757b73100baf0/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:05:25.475797 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:25.486109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe1b58-6981-494b-8b98-c4419d317973 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:25.830073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7f33c-e94e-4c87-aa42-5800536c84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:25.830073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7f33c-e94e-4c87-aa42-5800536c84b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:25.830073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7f33c-e94e-4c87-aa42-5800536c84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:25.830073 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7f33c-e94e-4c87-aa42-5800536c84b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:25.837710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7f33c-e94e-4c87-aa42-5800536c84b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:25.837710 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7f33c-e94e-4c87-aa42-5800536c84b5 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:25.838690 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:25.838848 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 787/1572] 10.222.0.58 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:05:25.839149 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0071ef-5bc5-4fe2-a256-52b7b7b1c99d admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:25.839149 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:25.839149 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:25.839149 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:25.839771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] PATH_INFO: `/v3/projects/87bfeb6b4cfd4b9fab241d880cf5b2cc/users/ea77d77ff7cb47e3869757b73100baf0/roles/82d5022e454c445f8cefd903b8eef5b0` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:25.839771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bfeb6b4cfd4b9fab241d880cf5b2cc, user_id=ea77d77ff7cb47e3869757b73100baf0, role_id=82d5022e454c445f8cefd903b8eef5b0)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:25.839771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:25.839771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 786/1573] 10.222.0.58 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:25 2022] PUT /identity/v3/projects/87bfeb6b4cfd4b9fab241d880cf5b2cc/users/ea77d77ff7cb47e3869757b73100baf0/roles/82d5022e454c445f8cefd903b8eef5b0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:32.984534 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d198f2-a1a7-4d08-8c31-47dff6edd643 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:32.984992 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d198f2-a1a7-4d08-8c31-47dff6edd643 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:32.985075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d198f2-a1a7-4d08-8c31-47dff6edd643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:33.023064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c7d198f2-a1a7-4d08-8c31-47dff6edd643 None None] MFA Rules not processed for user `a927ac169bb948cebf51e9d4089e3eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:33.023064 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c7d198f2-a1a7-4d08-8c31-47dff6edd643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:33.148092 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 788/1574] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:33.165959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:33.168322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:33.289732 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeb81a-67a1-4c3c-a76c-3abb2a246f02 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:33.294366 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc80df87ba14b3595e171a0e8fd6f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:33.299350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:33.299350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:33.299350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:33.305099 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c774-62db-4683-be83-4193831801c7 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:33.305469 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c774-62db-4683-be83-4193831801c7 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:33.305805 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99c774-62db-4683-be83-4193831801c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:33.344168 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-dd99c774-62db-4683-be83-4193831801c7 None None] MFA Rules not processed for user `ea77d77ff7cb47e3869757b73100baf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:33.345443 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-dd99c774-62db-4683-be83-4193831801c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:33.380141 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:33.382791 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:33.401259 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:33.411844 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 787/1575] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:33.448564 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 789/1576] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:33.459709 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:33.461229 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:33.477022 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2174cc-994a-4489-9030-fb3c5d183ff0 service glance] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:33.482468 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc80df87ba14b3595e171a0e8fd6f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:33.483092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:33.483394 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:33.483664 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:33.513341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:33.551665 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:33.554065 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:33.574037 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 788/1577] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:33.716247 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b765b-0f51-4232-9628-d176a32504f1 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:33.716639 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b765b-0f51-4232-9628-d176a32504f1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:33.717016 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b765b-0f51-4232-9628-d176a32504f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:33.793408 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-527b765b-0f51-4232-9628-d176a32504f1 None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:33.795341 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-527b765b-0f51-4232-9628-d176a32504f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:33.884238 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 790/1578] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:34.229419 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:34.230945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:34.347725 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2edcd-d9e7-49b5-bf7f-10dd9a84b9d4 service glance] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:34.354349 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:34.354985 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:34.355594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:34.355594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:34.365959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:34.367640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:34.377057 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 789/1579] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:05:35.695133 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fdb34-b633-4deb-9e46-bad0ba1d1e25 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:35.696041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fdb34-b633-4deb-9e46-bad0ba1d1e25 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:35.696494 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fdb34-b633-4deb-9e46-bad0ba1d1e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:35.731939 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-fe8fdb34-b633-4deb-9e46-bad0ba1d1e25 None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:35.734127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-fe8fdb34-b633-4deb-9e46-bad0ba1d1e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:35.807840 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 791/1580] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:35.826136 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:35.843063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc1c10-68bc-497f-ad23-73db71b93429 service swift] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:35.889650 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3ff0-9f13-417a-bafa-499ac077ad98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:35.890085 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3ff0-9f13-417a-bafa-499ac077ad98 service swift] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:35.890365 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3ff0-9f13-417a-bafa-499ac077ad98 service swift] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:35.890640 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3ff0-9f13-417a-bafa-499ac077ad98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:35.902889 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3ff0-9f13-417a-bafa-499ac077ad98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:35.904565 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3ff0-9f13-417a-bafa-499ac077ad98 service swift] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:35.925559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 790/1581] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:05:45.712919 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=54 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:45.922060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=63 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:46.288573 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d1c8-a469-43cd-896c-1a8c9c0a5f42 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.288849 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d1c8-a469-43cd-896c-1a8c9c0a5f42 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.292619 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d1c8-a469-43cd-896c-1a8c9c0a5f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.309178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-3175d1c8-a469-43cd-896c-1a8c9c0a5f42 None None] MFA Rules not processed for user `b1b39b1f1d6c4e34a8c56c31ced3d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:46.310417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-3175d1c8-a469-43cd-896c-1a8c9c0a5f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:46.319053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 792/1582] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:46.647787 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c80722-395e-4814-aaae-dabd68701fbf None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.648255 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c80722-395e-4814-aaae-dabd68701fbf None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.648705 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c80722-395e-4814-aaae-dabd68701fbf None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.651213 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 791/1583] 10.222.0.58 () {54 vars in 962 bytes} [Sun Aug 28 01:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:46.657137 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23deccf-6795-49ef-b5cb-019d060e27b1 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.658856 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23deccf-6795-49ef-b5cb-019d060e27b1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.658856 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23deccf-6795-49ef-b5cb-019d060e27b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.706226 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b23deccf-6795-49ef-b5cb-019d060e27b1 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:46.707582 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b23deccf-6795-49ef-b5cb-019d060e27b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:46.776161 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 793/1584] 10.222.0.58 () {58 vars in 1059 bytes} [Sun Aug 28 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:46.781713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d624a9-5f30-4438-91d3-98c8de99b1e6 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.781999 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d624a9-5f30-4438-91d3-98c8de99b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.782273 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d624a9-5f30-4438-91d3-98c8de99b1e6 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.783639 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 792/1585] 10.222.0.58 () {54 vars in 912 bytes} [Sun Aug 28 01:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:46.789517 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e160-ad1f-40cc-9494-3493f7ad82bd None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.789800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e160-ad1f-40cc-9494-3493f7ad82bd None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.790071 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e160-ad1f-40cc-9494-3493f7ad82bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.810704 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-ad19e160-ad1f-40cc-9494-3493f7ad82bd None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:46.817549 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-ad19e160-ad1f-40cc-9494-3493f7ad82bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:46.822382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 794/1586] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:46.835352 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d624a9-5f30-4438-91d3-98c8de99b1e6 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:46.849547 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d624a9-5f30-4438-91d3-98c8de99b1e6 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:46.853910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaef1f-6c52-472d-ad41-1ae974ed8aa4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bc80df87ba14b3595e171a0e8fd6f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:46.854557 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaef1f-6c52-472d-ad41-1ae974ed8aa4 service glance] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.854836 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaef1f-6c52-472d-ad41-1ae974ed8aa4 service glance] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.855157 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaef1f-6c52-472d-ad41-1ae974ed8aa4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.867956 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaef1f-6c52-472d-ad41-1ae974ed8aa4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:46.869963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaef1f-6c52-472d-ad41-1ae974ed8aa4 service glance] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:46.883403 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 793/1587] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:05:47.372723 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcb12a-2524-45ca-ad01-79548ed3aec6 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:47.373024 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcb12a-2524-45ca-ad01-79548ed3aec6 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:47.373334 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcb12a-2524-45ca-ad01-79548ed3aec6 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:47.374691 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 795/1588] 10.222.0.58 () {54 vars in 912 bytes} [Sun Aug 28 01:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:47.380749 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6667661-348c-4ed7-897a-cb090a4070b1 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:47.381245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6667661-348c-4ed7-897a-cb090a4070b1 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:47.381337 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6667661-348c-4ed7-897a-cb090a4070b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:47.421397 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-c6667661-348c-4ed7-897a-cb090a4070b1 None None] MFA Rules not processed for user `487a390503154187ab842e40b2a2fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:47.422609 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-c6667661-348c-4ed7-897a-cb090a4070b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:47.482031 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 794/1589] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:05:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:47.495634 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcb12a-2524-45ca-ad01-79548ed3aec6 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:47.510374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcb12a-2524-45ca-ad01-79548ed3aec6 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:47.514117 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61384246-df1d-4e79-b865-12971558e519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:47.514719 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61384246-df1d-4e79-b865-12971558e519 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:47.514992 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61384246-df1d-4e79-b865-12971558e519 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:47.515293 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61384246-df1d-4e79-b865-12971558e519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:47.526983 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61384246-df1d-4e79-b865-12971558e519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:47.528462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61384246-df1d-4e79-b865-12971558e519 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:47.537504 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 796/1590] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:48.043376 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f200f-cb2c-4a72-8b17-93a42b73ff97 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:48.043713 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f200f-cb2c-4a72-8b17-93a42b73ff97 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:48.044318 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f200f-cb2c-4a72-8b17-93a42b73ff97 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:48.045728 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 795/1591] 10.222.0.58 () {54 vars in 962 bytes} [Sun Aug 28 01:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:48.052162 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636875ca-7693-4e81-80c9-e1834278fb17 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:48.052669 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636875ca-7693-4e81-80c9-e1834278fb17 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:48.052761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636875ca-7693-4e81-80c9-e1834278fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:48.074285 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-636875ca-7693-4e81-80c9-e1834278fb17 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:48.075558 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-636875ca-7693-4e81-80c9-e1834278fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:48.075694 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f200f-cb2c-4a72-8b17-93a42b73ff97 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:48.086588 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 797/1592] 10.222.0.58 () {58 vars in 1059 bytes} [Sun Aug 28 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:48.092382 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ccacf-104a-4146-9902-a7bfc104f3aa None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:48.092664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ccacf-104a-4146-9902-a7bfc104f3aa None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:48.093074 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ccacf-104a-4146-9902-a7bfc104f3aa None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:48.094306 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 798/1593] 10.222.0.58 () {54 vars in 912 bytes} [Sun Aug 28 01:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:05:48.099742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b886-a8b1-4452-955c-717950ba2993 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:48.099742 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b886-a8b1-4452-955c-717950ba2993 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:48.099978 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b886-a8b1-4452-955c-717950ba2993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:48.119762 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-12e9b886-a8b1-4452-955c-717950ba2993 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:48.120985 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-12e9b886-a8b1-4452-955c-717950ba2993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:48.131756 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 799/1594] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:48.151322 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9b886-a8b1-4452-955c-717950ba2993 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:48.159908 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f200f-cb2c-4a72-8b17-93a42b73ff97 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:48.161344 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9b886-a8b1-4452-955c-717950ba2993 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:48.165048 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71de6ef4ed504cfe8289c8ec519405bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:48.165295 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee6eb-7640-4807-af68-923f0c6747bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:48.165660 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:48.165936 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:48.166039 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee6eb-7640-4807-af68-923f0c6747bc service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:48.166204 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:48.166304 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee6eb-7640-4807-af68-923f0c6747bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:48.166477 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee6eb-7640-4807-af68-923f0c6747bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:48.167954 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:48.178211 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee6eb-7640-4807-af68-923f0c6747bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:48.179749 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee6eb-7640-4807-af68-923f0c6747bc service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:48.180379 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:48.182028 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:48.191530 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 800/1595] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:48.193587 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 796/1596] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:51.807043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905159d-f057-4a25-b6f8-1fe0dfd5d3f8 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:51.807729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905159d-f057-4a25-b6f8-1fe0dfd5d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:51.807729 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905159d-f057-4a25-b6f8-1fe0dfd5d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:51.833083 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-6905159d-f057-4a25-b6f8-1fe0dfd5d3f8 None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:51.834898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6905159d-f057-4a25-b6f8-1fe0dfd5d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:51.845800 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 801/1597] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:51.867004 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:51.886036 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d329b-e6a2-4037-9659-55196afa3e5a service placement] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:51.891477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:51.892098 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:51.892380 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:51.892662 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:51.902207 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:51.903866 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:51.913502 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 797/1598] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:06:00.345221 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00fbb8-6319-490b-9427-9fce0332760e None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:00.345768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00fbb8-6319-490b-9427-9fce0332760e None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:00.345768 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00fbb8-6319-490b-9427-9fce0332760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:00.366747 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-4c00fbb8-6319-490b-9427-9fce0332760e None None] MFA Rules not processed for user `487a390503154187ab842e40b2a2fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:00.368052 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-4c00fbb8-6319-490b-9427-9fce0332760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:00.375525 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 802/1599] 10.222.0.61 () {58 vars in 1015 bytes} [Sun Aug 28 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:06:00.397704 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:06:00.407306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5880-841b-41b6-9dfd-b7ff631cc5ab service swift] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:06:00.412102 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360685b9-220e-48e7-aa46-4043442f704f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:06:00.425243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360685b9-220e-48e7-aa46-4043442f704f service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:00.425243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360685b9-220e-48e7-aa46-4043442f704f service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:00.425243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360685b9-220e-48e7-aa46-4043442f704f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:00.425243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360685b9-220e-48e7-aa46-4043442f704f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:06:00.425243 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360685b9-220e-48e7-aa46-4043442f704f service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:06:00.431261 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 798/1600] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:06:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:06:01.417522 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb5c56-6ce2-46cb-b6a5-e8bb8ed8a406 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:01.418069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb5c56-6ce2-46cb-b6a5-e8bb8ed8a406 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:01.418069 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb5c56-6ce2-46cb-b6a5-e8bb8ed8a406 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:01.419484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 803/1601] 10.222.0.58 () {54 vars in 921 bytes} [Sun Aug 28 01:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:06:01.439583 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8946b5-6009-491b-b33b-0fab1fd03655 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:01.440139 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8946b5-6009-491b-b33b-0fab1fd03655 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:01.440139 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8946b5-6009-491b-b33b-0fab1fd03655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:01.464210 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-4a8946b5-6009-491b-b33b-0fab1fd03655 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:01.465505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4a8946b5-6009-491b-b33b-0fab1fd03655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:01.475578 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 799/1602] 10.222.0.58 () {58 vars in 1018 bytes} [Sun Aug 28 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:06:01.516028 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb5c56-6ce2-46cb-b6a5-e8bb8ed8a406 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:06:01.532957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb5c56-6ce2-46cb-b6a5-e8bb8ed8a406 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:06:01.540726 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941657d2-ffc9-4083-812a-50a79a58c827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:06:01.542031 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941657d2-ffc9-4083-812a-50a79a58c827 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:01.542543 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941657d2-ffc9-4083-812a-50a79a58c827 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:01.542897 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941657d2-ffc9-4083-812a-50a79a58c827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:01.553734 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941657d2-ffc9-4083-812a-50a79a58c827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:06:01.555484 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941657d2-ffc9-4083-812a-50a79a58c827 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:06:01.567355 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 804/1603] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:06:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:06:07.551573 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f5e4-dff0-4944-be88-b385cf7e84af None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:07.552472 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f5e4-dff0-4944-be88-b385cf7e84af None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:07.552809 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f5e4-dff0-4944-be88-b385cf7e84af None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:07.555599 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 800/1604] 10.222.0.58 () {54 vars in 921 bytes} [Sun Aug 28 01:06:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:06:07.561979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9fda9-b196-46a2-a2d0-0a1e07afd217 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:07.562497 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9fda9-b196-46a2-a2d0-0a1e07afd217 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:07.562606 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9fda9-b196-46a2-a2d0-0a1e07afd217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:07.583542 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-d3b9fda9-b196-46a2-a2d0-0a1e07afd217 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:07.584761 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d3b9fda9-b196-46a2-a2d0-0a1e07afd217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:07.593947 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 805/1605] 10.222.0.58 () {58 vars in 1018 bytes} [Sun Aug 28 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:06:07.606919 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f5e4-dff0-4944-be88-b385cf7e84af None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:06:07.623436 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f5e4-dff0-4944-be88-b385cf7e84af None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:06:07.630143 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285c378-ad90-4695-92e1-b6dd919c5a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:06:07.630686 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285c378-ad90-4695-92e1-b6dd919c5a8c service nova] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:07.631154 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285c378-ad90-4695-92e1-b6dd919c5a8c service nova] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:07.631750 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285c378-ad90-4695-92e1-b6dd919c5a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:07.643507 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285c378-ad90-4695-92e1-b6dd919c5a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:06:07.645962 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285c378-ad90-4695-92e1-b6dd919c5a8c service nova] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:06:07.668778 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 801/1606] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:06:17.578085 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=76 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:06:17.655685 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=88 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:06:25.740155 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d89399-660d-4991-b39c-d2a4ea4ba661 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:25.740694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d89399-660d-4991-b39c-d2a4ea4ba661 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:25.740694 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d89399-660d-4991-b39c-d2a4ea4ba661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:25.759741 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-69d89399-660d-4991-b39c-d2a4ea4ba661 None None] MFA Rules not processed for user `c2ace0b690a94582811ea593384f6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:25.761053 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-69d89399-660d-4991-b39c-d2a4ea4ba661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:25.767675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 806/1607] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:06:26.138654 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d32fb-c10f-4b46-848a-40e982ca66ff None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:26.139247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d32fb-c10f-4b46-848a-40e982ca66ff None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:26.139247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d32fb-c10f-4b46-848a-40e982ca66ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:26.160775 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-7b9d32fb-c10f-4b46-848a-40e982ca66ff None None] MFA Rules not processed for user `487a390503154187ab842e40b2a2fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:26.162364 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-7b9d32fb-c10f-4b46-848a-40e982ca66ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:26.170040 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 802/1608] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:06:26.182721 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d89399-660d-4991-b39c-d2a4ea4ba661 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:06:26.193539 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d89399-660d-4991-b39c-d2a4ea4ba661 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:06:26.197233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f126479-9db1-44ec-a850-8e73a21556a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:06:26.197874 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126479-9db1-44ec-a850-8e73a21556a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:26.198423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126479-9db1-44ec-a850-8e73a21556a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:26.198423 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126479-9db1-44ec-a850-8e73a21556a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:26.205926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f126479-9db1-44ec-a850-8e73a21556a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:06:26.207988 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f126479-9db1-44ec-a850-8e73a21556a5 service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:06:26.216414 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 807/1609] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:06:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:06:31.280737 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d32fb-c10f-4b46-848a-40e982ca66ff None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:06:31.290605 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d32fb-c10f-4b46-848a-40e982ca66ff None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:06:31.294237 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb30120-a345-40a5-be6d-c557d4944620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:06:31.294834 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb30120-a345-40a5-be6d-c557d4944620 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:31.295135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb30120-a345-40a5-be6d-c557d4944620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:31.295417 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb30120-a345-40a5-be6d-c557d4944620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:31.305859 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb30120-a345-40a5-be6d-c557d4944620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:06:31.307607 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb30120-a345-40a5-be6d-c557d4944620 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:06:31.318799 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 803/1610] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:06:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:06:33.903195 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe5346-e654-4c17-94dd-11c81b0127a1 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:33.903745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe5346-e654-4c17-94dd-11c81b0127a1 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:33.903745 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe5346-e654-4c17-94dd-11c81b0127a1 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:33.905330 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 808/1611] 10.222.0.58 () {54 vars in 921 bytes} [Sun Aug 28 01:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:06:33.911826 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2736-9a5c-4322-b28f-255f519c0079 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:33.912387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2736-9a5c-4322-b28f-255f519c0079 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:33.912387 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2736-9a5c-4322-b28f-255f519c0079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:33.935461 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-fa7d2736-9a5c-4322-b28f-255f519c0079 None None] MFA Rules not processed for user `d1cdc7db1f714849ba14a987d2412591`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:33.936745 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-fa7d2736-9a5c-4322-b28f-255f519c0079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:33.947265 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 804/1612] 10.222.0.58 () {58 vars in 1018 bytes} [Sun Aug 28 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:06:33.961116 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe5346-e654-4c17-94dd-11c81b0127a1 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:06:33.977857 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe5346-e654-4c17-94dd-11c81b0127a1 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:06:33.984681 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f231f6-4281-494b-b515-0c0221dcc524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:06:33.985441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f231f6-4281-494b-b515-0c0221dcc524 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:33.985783 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f231f6-4281-494b-b515-0c0221dcc524 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:33.986115 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f231f6-4281-494b-b515-0c0221dcc524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:33.995695 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f231f6-4281-494b-b515-0c0221dcc524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:06:33.997607 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f231f6-4281-494b-b515-0c0221dcc524 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:06:34.010466 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 809/1613] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:06:43.928761 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=12 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:06:44.004289 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=15 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:15.127767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587940a-df00-4cae-83e8-ac010c674da0 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:15.128361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587940a-df00-4cae-83e8-ac010c674da0 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:15.128361 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587940a-df00-4cae-83e8-ac010c674da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:15.147628 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e587940a-df00-4cae-83e8-ac010c674da0 None None] MFA Rules not processed for user `c2ace0b690a94582811ea593384f6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:15.148850 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e587940a-df00-4cae-83e8-ac010c674da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:15.155766 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 805/1614] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:07:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:25.141731 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:34.831283 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0b9d-ef46-4ca6-be56-cd3bec33c7c8 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:34.831957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0b9d-ef46-4ca6-be56-cd3bec33c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:34.831957 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0b9d-ef46-4ca6-be56-cd3bec33c7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:34.851222 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-750a0b9d-ef46-4ca6-be56-cd3bec33c7c8 None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:34.852409 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-750a0b9d-ef46-4ca6-be56-cd3bec33c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:34.859506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 810/1615] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:34.900913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587940a-df00-4cae-83e8-ac010c674da0 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:34.913199 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587940a-df00-4cae-83e8-ac010c674da0 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:34.918075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98849a-45cb-4710-9fa8-f9c7893dcdb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:34.918707 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98849a-45cb-4710-9fa8-f9c7893dcdb3 service swift] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:34.918982 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98849a-45cb-4710-9fa8-f9c7893dcdb3 service swift] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:34.919405 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98849a-45cb-4710-9fa8-f9c7893dcdb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:34.929767 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98849a-45cb-4710-9fa8-f9c7893dcdb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:34.931469 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98849a-45cb-4710-9fa8-f9c7893dcdb3 service swift] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:34.939989 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 806/1616] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:07:38.411506 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f314-b65b-47df-b76e-a4248d2cc53f None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:38.411992 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f314-b65b-47df-b76e-a4248d2cc53f None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:38.412075 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f314-b65b-47df-b76e-a4248d2cc53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:38.430820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-c968f314-b65b-47df-b76e-a4248d2cc53f None None] MFA Rules not processed for user `c2ace0b690a94582811ea593384f6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:38.432059 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-c968f314-b65b-47df-b76e-a4248d2cc53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:38.438822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 811/1617] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:07:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:44.938046 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=6 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:48.425822 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=6 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:11.870247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef902a-e3a7-4265-8ddb-b677afcc5ad9 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:11.870740 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef902a-e3a7-4265-8ddb-b677afcc5ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:11.870830 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef902a-e3a7-4265-8ddb-b677afcc5ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:11.889963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-d8ef902a-e3a7-4265-8ddb-b677afcc5ad9 None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:08:11.891245 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-d8ef902a-e3a7-4265-8ddb-b677afcc5ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:11.898437 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 807/1618] 10.222.0.58 () {58 vars in 967 bytes} [Sun Aug 28 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:08:11.912120 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968f314-b65b-47df-b76e-a4248d2cc53f None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:11.924676 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968f314-b65b-47df-b76e-a4248d2cc53f None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:11.929858 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:11.930447 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:11.930722 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:11.930993 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:11.939000 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:11.940617 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:11.948652 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 812/1619] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:08:21.884821 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:21.945578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=6 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:30.607673 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d29b1-fe50-4c3a-bb65-b1b13b30b46e None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:30.608160 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d29b1-fe50-4c3a-bb65-b1b13b30b46e None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:30.608268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d29b1-fe50-4c3a-bb65-b1b13b30b46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:30.626834 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-863d29b1-fe50-4c3a-bb65-b1b13b30b46e None None] MFA Rules not processed for user `c2ace0b690a94582811ea593384f6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:08:30.628075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-863d29b1-fe50-4c3a-bb65-b1b13b30b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:30.635735 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 808/1620] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:08:40.621814 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:48.241345 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:48.251193 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba74496-3480-4f1c-b980-610b3ace7b40 service swift] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:48.254727 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34807518-8778-4a73-8328-2f7a04bcfb0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:48.255355 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34807518-8778-4a73-8328-2f7a04bcfb0d service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:48.255631 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34807518-8778-4a73-8328-2f7a04bcfb0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:48.255898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34807518-8778-4a73-8328-2f7a04bcfb0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:48.265666 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34807518-8778-4a73-8328-2f7a04bcfb0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:48.267090 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34807518-8778-4a73-8328-2f7a04bcfb0d service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:48.276739 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 813/1621] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:08:58.272374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=6 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:41.221825 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2abcc-e119-440c-bb67-be0b55d80840 None None] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:41.222400 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2abcc-e119-440c-bb67-be0b55d80840 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:41.222697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2abcc-e119-440c-bb67-be0b55d80840 None None] PATH_INFO: `/` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:41.224457 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 809/1622] 10.222.0.58 () {54 vars in 961 bytes} [Sun Aug 28 01:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:09:41.229789 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206f5c-2b05-470d-b223-16d8b7856280 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:41.230270 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206f5c-2b05-470d-b223-16d8b7856280 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:41.230547 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206f5c-2b05-470d-b223-16d8b7856280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:41.257903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-25206f5c-2b05-470d-b223-16d8b7856280 None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:09:41.259233 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-25206f5c-2b05-470d-b223-16d8b7856280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:41.270579 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 814/1623] 10.222.0.58 () {58 vars in 1058 bytes} [Sun Aug 28 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:09:41.279244 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2abcc-e119-440c-bb67-be0b55d80840 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:41.297921 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2abcc-e119-440c-bb67-be0b55d80840 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:41.302864 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71de6ef4ed504cfe8289c8ec519405bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:41.303703 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:41.303981 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:41.304247 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:41.313911 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:41.315546 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:41.325653 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 810/1624] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:09:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:09:47.617883 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb77a-3ce9-4c37-ba34-a479663fa4da None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:47.618338 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb77a-3ce9-4c37-ba34-a479663fa4da None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:47.618468 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcb77a-3ce9-4c37-ba34-a479663fa4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:47.637653 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-b3dcb77a-3ce9-4c37-ba34-a479663fa4da None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:09:47.638894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-b3dcb77a-3ce9-4c37-ba34-a479663fa4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:47.646846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 815/1625] 10.222.0.58 () {58 vars in 967 bytes} [Sun Aug 28 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:09:47.798320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:47.809477 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4f075-2ae2-44fc-8985-52c574cdf1ff service placement] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:47.814928 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:47.815549 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:47.815825 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:47.816092 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:47.823979 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:47.825543 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:47.834146 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 811/1626] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:09:49.153757 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48485-abd1-4528-bab7-7d6adece9a49 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:49.154208 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48485-abd1-4528-bab7-7d6adece9a49 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:49.154418 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48485-abd1-4528-bab7-7d6adece9a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:49.174842 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-33b48485-abd1-4528-bab7-7d6adece9a49 None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:09:49.176080 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-33b48485-abd1-4528-bab7-7d6adece9a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:49.183563 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 816/1627] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:09:49.196168 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:49.207467 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3dfe0-ce59-4363-858d-0737fe7b0570 service swift] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:49.212171 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4f98-fdff-4b72-8bc9-5af0407dea82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:49.212771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f98-fdff-4b72-8bc9-5af0407dea82 service swift] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:49.213043 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f98-fdff-4b72-8bc9-5af0407dea82 service swift] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:49.213312 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f98-fdff-4b72-8bc9-5af0407dea82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:49.222905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4f98-fdff-4b72-8bc9-5af0407dea82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:49.224631 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4f98-fdff-4b72-8bc9-5af0407dea82 service swift] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:49.233446 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 812/1628] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:09:59.169498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=9 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:59.229895 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=18 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:59.589089 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc99a-2021-4387-8b73-24321c4b9391 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:59.589370 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc99a-2021-4387-8b73-24321c4b9391 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:59.589646 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc99a-2021-4387-8b73-24321c4b9391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:59.609319 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a57dc99a-2021-4387-8b73-24321c4b9391 None None] MFA Rules not processed for user `b1b39b1f1d6c4e34a8c56c31ced3d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:09:59.610583 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a57dc99a-2021-4387-8b73-24321c4b9391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:59.617706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 817/1629] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:02.641680 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5300-e01a-4ce8-ba8a-150133aa913c None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:02.642152 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5300-e01a-4ce8-ba8a-150133aa913c None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:02.642248 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5300-e01a-4ce8-ba8a-150133aa913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:02.668905 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-612c5300-e01a-4ce8-ba8a-150133aa913c None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:02.670322 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-612c5300-e01a-4ce8-ba8a-150133aa913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:02.678071 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 813/1630] 10.222.0.58 () {58 vars in 1009 bytes} [Sun Aug 28 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:02.691279 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dc99a-2021-4387-8b73-24321c4b9391 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:02.703455 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dc99a-2021-4387-8b73-24321c4b9391 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:02.709263 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:02.709807 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:02.710086 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:02.710390 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:02.718903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:02.720724 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:02.729467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 818/1631] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:10:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:10:12.660559 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=3 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:12.725830 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=9 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:32.715445 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5300-e01a-4ce8-ba8a-150133aa913c None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:32.726192 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5300-e01a-4ce8-ba8a-150133aa913c None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:32.729995 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:32.730781 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:32.731059 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:32.731360 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:32.740575 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:32.742887 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:32.752616 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 814/1632] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:42.748350 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=6 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:45.451056 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:45.463271 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4b55-3f5c-4d9a-87c7-2f96a50c4062 service swift] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:45.469346 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132640b-84b5-4ca5-9ddf-e721a3503edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:45.469951 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132640b-84b5-4ca5-9ddf-e721a3503edb service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:45.470572 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132640b-84b5-4ca5-9ddf-e721a3503edb service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:45.470572 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132640b-84b5-4ca5-9ddf-e721a3503edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:45.480816 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132640b-84b5-4ca5-9ddf-e721a3503edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:45.482580 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132640b-84b5-4ca5-9ddf-e721a3503edb service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:45.492804 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 819/1633] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:45.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:45.932555 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44390a1-3b56-4548-bc37-7287cad5d6d2 service neutron] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:45.936878 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:45.937484 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:45.937764 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:45.938033 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:45.949386 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:45.950959 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:45.963683 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 815/1634] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:50.580698 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698bbf5-411a-4e54-a0c0-ea97671345e9 None None] REQUEST_METHOD: `POST` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:50.581206 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698bbf5-411a-4e54-a0c0-ea97671345e9 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:50.581302 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698bbf5-411a-4e54-a0c0-ea97671345e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:50.600926 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.auth.core [None req-a698bbf5-411a-4e54-a0c0-ea97671345e9 None None] MFA Rules not processed for user `c2ace0b690a94582811ea593384f6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:50.602146 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-a698bbf5-411a-4e54-a0c0-ea97671345e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:50.609109 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 820/1635] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:50.943945 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:50.953240 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ba108-ef6e-4510-9678-fd3b0c80ee23 service neutron] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:50.956916 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:50.957508 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:50.957777 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:50.958128 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:50.965127 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:50.966579 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:50.974475 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 816/1636] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:52.733964 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698bbf5-411a-4e54-a0c0-ea97671345e9 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:52.745835 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698bbf5-411a-4e54-a0c0-ea97671345e9 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:52.751827 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71de6ef4ed504cfe8289c8ec519405bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:52.752437 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:52.752711 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:52.752979 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:52.761942 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:52.764068 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:52.774917 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 821/1637] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:53.843218 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:53.851900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446b6df-5834-46c1-aea4-46197d24c844 service neutron] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:53.855604 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:53.860454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:53.860454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:53.860454 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:53.868952 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:53.870407 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:53.883014 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 817/1638] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:02.770396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=15 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:03.877537 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=18 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:09.017775 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:09.029967 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6d38-4193-4ea1-ac41-a3967bf66df4 service placement] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:09.035514 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:09.036113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:09.036389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:09.036659 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:09.045735 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:09.047351 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:09.058012 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 822/1639] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:09.513623 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:09.522398 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450551-2f72-40f8-abd3-421e7728290e service neutron] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:09.526063 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022045-dd61-4108-8d9a-d327e9dd9e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:09.526697 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022045-dd61-4108-8d9a-d327e9dd9e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:09.526972 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022045-dd61-4108-8d9a-d327e9dd9e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:09.527285 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022045-dd61-4108-8d9a-d327e9dd9e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:09.535505 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022045-dd61-4108-8d9a-d327e9dd9e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:09.536924 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022045-dd61-4108-8d9a-d327e9dd9e0d service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:09.545112 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 818/1640] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:13.777295 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:13.783913 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccecaa-438e-412a-82da-f30b53e26ae6 service nova] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:13.789632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:13.790239 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:13.790516 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:13.790786 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:13.800772 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:13.802359 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:13.814136 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 823/1641] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:19.541521 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=6 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:23.808802 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=12 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:48.535041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04d5a-f2aa-4f80-aaad-7550c358b28f None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:48.536323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04d5a-f2aa-4f80-aaad-7550c358b28f None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:48.536323 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04d5a-f2aa-4f80-aaad-7550c358b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:48.555936 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-3ec04d5a-f2aa-4f80-aaad-7550c358b28f None None] MFA Rules not processed for user `22cbba46308046d7b15f6f3a14e9eab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:11:48.557427 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-3ec04d5a-f2aa-4f80-aaad-7550c358b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:48.566088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 819/1642] 10.222.0.58 () {58 vars in 967 bytes} [Sun Aug 28 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:11:48.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:48.620473 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68701ef4-e32a-479a-b54f-4b2cb17115b7 service nova] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:48.625545 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396ff0d-34c3-4112-9fe6-bb3699c0d38a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cc361c23f94761bec36dec15efe691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:48.626152 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396ff0d-34c3-4112-9fe6-bb3699c0d38a service swift] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:48.626485 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396ff0d-34c3-4112-9fe6-bb3699c0d38a service swift] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:48.627332 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396ff0d-34c3-4112-9fe6-bb3699c0d38a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:48.635862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396ff0d-34c3-4112-9fe6-bb3699c0d38a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:48.637441 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396ff0d-34c3-4112-9fe6-bb3699c0d38a service swift] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:48.645501 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 824/1643] 10.222.0.58 () {60 vars in 1384 bytes} [Sun Aug 28 01:11:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:11:49.530041 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04d5a-f2aa-4f80-aaad-7550c358b28f None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:49.540636 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04d5a-f2aa-4f80-aaad-7550c358b28f None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:49.544613 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6322e-02f0-4b0c-a731-4e6d8075207b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:49.545079 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6322e-02f0-4b0c-a731-4e6d8075207b service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:49.545733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6322e-02f0-4b0c-a731-4e6d8075207b service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:49.545733 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6322e-02f0-4b0c-a731-4e6d8075207b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:49.610273 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6322e-02f0-4b0c-a731-4e6d8075207b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:49.612074 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6322e-02f0-4b0c-a731-4e6d8075207b service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:49.622106 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 820/1644] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:53.699706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de97d8-bdb4-43ea-ae5c-bee6ff7ebbc2 None None] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:53.700210 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de97d8-bdb4-43ea-ae5c-bee6ff7ebbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:53.700396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de97d8-bdb4-43ea-ae5c-bee6ff7ebbc2 None None] PATH_INFO: `/` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:53.701915 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 825/1645] 10.222.0.58 () {54 vars in 921 bytes} [Sun Aug 28 01:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:11:53.729645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe832-64be-4e3a-8dde-2eee60c22cc9 None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:53.730175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe832-64be-4e3a-8dde-2eee60c22cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:53.730333 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe832-64be-4e3a-8dde-2eee60c22cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:53.750768 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-e4dfe832-64be-4e3a-8dde-2eee60c22cc9 None None] MFA Rules not processed for user `71de6ef4ed504cfe8289c8ec519405bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:11:53.752060 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e4dfe832-64be-4e3a-8dde-2eee60c22cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:53.760983 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 821/1646] 10.222.0.58 () {58 vars in 1018 bytes} [Sun Aug 28 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:11:53.773144 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de97d8-bdb4-43ea-ae5c-bee6ff7ebbc2 None None] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:53.787798 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de97d8-bdb4-43ea-ae5c-bee6ff7ebbc2 None None] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:53.792812 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71de6ef4ed504cfe8289c8ec519405bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:53.793403 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:53.793680 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:53.793973 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:53.802716 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:53.804316 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:53.815164 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 826/1647] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:11:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:57.549180 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe832-64be-4e3a-8dde-2eee60c22cc9 None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:57.561646 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe832-64be-4e3a-8dde-2eee60c22cc9 None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:57.566884 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:57.567552 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:57.567833 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:57.568105 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] PATH_INFO: `/v3/users/b1b39b1f1d6c4e34a8c56c31ced3d50b` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:57.569236 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b39b1f1d6c4e34a8c56c31ced3d50b)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:57.571195 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:57.724677 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b39b1f1d6c4e34a8c56c31ced3d50b'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:57.731666 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b39b1f1d6c4e34a8c56c31ced3d50b'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:57.744290 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b39b1f1d6c4e34a8c56c31ced3d50b'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:57.744997 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b39b1f1d6c4e34a8c56c31ced3d50b'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:57.745624 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b39b1f1d6c4e34a8c56c31ced3d50b'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:57.807306 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 822/1648] 10.222.0.58 () {58 vars in 1224 bytes} [Sun Aug 28 01:11:57 2022] DELETE /identity/v3/users/b1b39b1f1d6c4e34a8c56c31ced3d50b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:11:58.039281 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:58.055390 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f583-4176-4b02-998c-052fc62ad9e6 service placement] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:58.114374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:58.115048 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:58.115360 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:58.115632 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] PATH_INFO: `/v3/projects/f26060ecd8944d90a9c8529d352699ec` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:58.116846 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26060ecd8944d90a9c8529d352699ec)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:58.118779 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:58.242314 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26060ecd8944d90a9c8529d352699ec', 'request_id': 'req-26f89b27-7bee-43dc-b60c-acb3e1597ab8'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.251231 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26060ecd8944d90a9c8529d352699ec', 'request_id': 'req-26f89b27-7bee-43dc-b60c-acb3e1597ab8'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.259077 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26060ecd8944d90a9c8529d352699ec', 'request_id': 'req-26f89b27-7bee-43dc-b60c-acb3e1597ab8'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.367601 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] The token cache is being invalidate because project f26060ecd8944d90a9c8529d352699ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:11:58.367896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.372166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.372166 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 827/1649] 10.222.0.58 () {58 vars in 1233 bytes} [Sun Aug 28 01:11:58 2022] DELETE /identity/v3/projects/f26060ecd8944d90a9c8529d352699ec => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:11:58.374118 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:58.375726 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:58.389442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ec2b-3030-4e23-9df3-1a3602af8e7b admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:58.438910 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:58.447719 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:58.457431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:58.457431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:58.457431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] PATH_INFO: `/v3/users/a927ac169bb948cebf51e9d4089e3eec` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:58.457431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a927ac169bb948cebf51e9d4089e3eec)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:58.457431 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:58.661499 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a927ac169bb948cebf51e9d4089e3eec'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.668411 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a927ac169bb948cebf51e9d4089e3eec'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.681208 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a927ac169bb948cebf51e9d4089e3eec'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.682190 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a927ac169bb948cebf51e9d4089e3eec'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.682805 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-bda39998-3af1-4351-8558-ad4c8b79aeff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a927ac169bb948cebf51e9d4089e3eec'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:58.749756 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 823/1650] 10.222.0.58 () {58 vars in 1224 bytes} [Sun Aug 28 01:11:58 2022] DELETE /identity/v3/users/a927ac169bb948cebf51e9d4089e3eec => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:11:59.014576 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:59.022562 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:59.036753 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f89b27-7bee-43dc-b60c-acb3e1597ab8 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:59.094414 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:59.095167 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:59.095933 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:59.096356 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] PATH_INFO: `/v3/projects/cd267ebdfbc148eb82f27a519bd251fd` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:59.097549 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd267ebdfbc148eb82f27a519bd251fd)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:59.099465 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:59.105884 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:59.219047 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd267ebdfbc148eb82f27a519bd251fd', 'request_id': 'req-5a5c105d-0dda-4d44-93e4-4d54c700d410'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:59.226533 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd267ebdfbc148eb82f27a519bd251fd', 'request_id': 'req-5a5c105d-0dda-4d44-93e4-4d54c700d410'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:59.232119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd267ebdfbc148eb82f27a519bd251fd', 'request_id': 'req-5a5c105d-0dda-4d44-93e4-4d54c700d410'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:59.316127 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] The token cache is being invalidate because project cd267ebdfbc148eb82f27a519bd251fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:11:59.316421 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:59.317119 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:59.318641 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 828/1651] 10.222.0.58 () {58 vars in 1233 bytes} [Sun Aug 28 01:11:59 2022] DELETE /identity/v3/projects/cd267ebdfbc148eb82f27a519bd251fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:08.746143 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:09.312448 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:01.303320 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] REQUEST_METHOD: `POST` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:01.303998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:01.303998 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:01.340193 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.auth.core [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] MFA Rules not processed for user `c2ace0b690a94582811ea593384f6b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:01.341442 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:01.426382 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 824/1652] 10.222.0.58 () {58 vars in 958 bytes} [Sun Aug 28 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:01.819959 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:01.826513 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:01.939274 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c105d-0dda-4d44-93e4-4d54c700d410 admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:01.943131 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:01.943766 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:01.944043 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:01.944313 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:01.946178 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:01.956672 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:01.958219 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:01.967467 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 829/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:11.424175 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=37 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:11.963461 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=44 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:42.066823 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.068416 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:42.186088 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152e164-7e51-4344-82ab-6fb60ef816dc None None] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:42.192344 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71de6ef4ed504cfe8289c8ec519405bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:42.193021 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.193335 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.193645 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.195829 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:42.208762 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:42.210710 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.223380 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 825/1654] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:52.217792 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=44 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:57.891664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:57.891664 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:58.086655 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c6700-14d5-402c-96d5-0c16e204110c service neutron] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:58.096709 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cdc7db1f714849ba14a987d2412591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:58.097784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:58.098262 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:58.098730 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:58.101894 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:58.125498 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:58.129358 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:58.150417 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 830/1655] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:08.141132 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=46 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:14.697405 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:14.699032 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:14.714341 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9506-9590-47b2-8818-2079bb4cfabf service placement] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:14.720732 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487a390503154187ab842e40b2a2fbbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:14.721820 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] REQUEST_METHOD: `GET` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:14.722363 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:14.722790 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:14.725913 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:14.835835 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:14.837227 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:14.860036 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 826/1656] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:15:24.339578 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:24.341433 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:24.369088 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a7a0-e33a-4d8d-b9a7-0b377c444065 service nova] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:24.376622 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:24.377357 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:24.377793 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:24.378255 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] PATH_INFO: `/v3/users/c2ace0b690a94582811ea593384f6b0f` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:24.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ace0b690a94582811ea593384f6b0f)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:24.409387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: WARNING py.warnings [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:15:24.409387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: warnings.warn(msg) Aug 28 01:15:24.409387 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: Aug 28 01:15:24.410675 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:24.654862 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ace0b690a94582811ea593384f6b0f'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:24.655690 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ace0b690a94582811ea593384f6b0f'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:24.680546 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ace0b690a94582811ea593384f6b0f'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:24.692931 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ace0b690a94582811ea593384f6b0f'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:24.806400 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ace0b690a94582811ea593384f6b0f'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:24.814593 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 831/1657] 10.222.0.58 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:24 2022] DELETE /identity/v3/users/c2ace0b690a94582811ea593384f6b0f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:24.856789 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=43 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:25.095594 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:25.109268 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937c8e-1f52-4bef-a57c-3ca238e2e204 service neutron] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:25.187471 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:25.188057 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:25.188334 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:25.188963 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] PATH_INFO: `/v3/projects/0be0d4807eb64cefa75cd93552992435` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:25.201401 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be0d4807eb64cefa75cd93552992435)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:25.202481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: WARNING py.warnings [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:15:25.202481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: warnings.warn(msg) Aug 28 01:15:25.202481 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: Aug 28 01:15:25.203771 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:25.382291 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be0d4807eb64cefa75cd93552992435', 'request_id': 'req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.394556 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be0d4807eb64cefa75cd93552992435', 'request_id': 'req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.475162 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be0d4807eb64cefa75cd93552992435', 'request_id': 'req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.499420 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] The token cache is being invalidate because project 0be0d4807eb64cefa75cd93552992435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:25.499900 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.503794 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 827/1658] 10.222.0.58 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:25 2022] DELETE /identity/v3/projects/0be0d4807eb64cefa75cd93552992435 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:25.510113 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:25.512396 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:25.534903 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be4c8b-c44e-4860-b659-53551f8244df admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:25.622628 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:25.623706 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:25.624041 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:25.624376 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] PATH_INFO: `/v3/users/ea77d77ff7cb47e3869757b73100baf0` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:25.642898 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea77d77ff7cb47e3869757b73100baf0)` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:25.645125 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:25.885242 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea77d77ff7cb47e3869757b73100baf0'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.886012 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea77d77ff7cb47e3869757b73100baf0'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.891692 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:25.901752 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea77d77ff7cb47e3869757b73100baf0'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.911114 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea77d77ff7cb47e3869757b73100baf0'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.984372 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.notifications [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea77d77ff7cb47e3869757b73100baf0'} {{(pid=81581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:25.995896 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 832/1659] 10.222.0.58 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:25 2022] DELETE /identity/v3/users/ea77d77ff7cb47e3869757b73100baf0 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:26.318311 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Authenticating user token {{(pid=81582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:26.320075 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.fernet_utils [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:26.342593 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7630-6bd3-4c1c-b589-f6f43f9379b2 admin admin] Validating token access rules against request {{(pid=81582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:26.412701 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00caaefe5f7440c9962342f8ae00dd35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4a5e2ed24234c04bb44f2eb019170b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:26.413250 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:26.413523 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:26.413793 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] PATH_INFO: `/v3/projects/87bfeb6b4cfd4b9fab241d880cf5b2cc` {{(pid=81582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:26.428882 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87bfeb6b4cfd4b9fab241d880cf5b2cc)` {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:26.431449 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] RBAC: Authorization granted {{(pid=81582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:26.452391 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:26.555135 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87bfeb6b4cfd4b9fab241d880cf5b2cc', 'request_id': 'req-01433314-3e38-438d-aef0-9596450beff4'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:26.562458 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87bfeb6b4cfd4b9fab241d880cf5b2cc', 'request_id': 'req-01433314-3e38-438d-aef0-9596450beff4'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:26.647567 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87bfeb6b4cfd4b9fab241d880cf5b2cc', 'request_id': 'req-01433314-3e38-438d-aef0-9596450beff4'} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:26.661909 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] The token cache is being invalidate because project 87bfeb6b4cfd4b9fab241d880cf5b2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:26.662181 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:26.662944 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG keystone.notifications [None req-01433314-3e38-438d-aef0-9596450beff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:26.664476 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: [pid: 81582|app: 0|req: 828/1660] 10.222.0.58 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:26 2022] DELETE /identity/v3/projects/87bfeb6b4cfd4b9fab241d880cf5b2cc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:36.040668 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG dbcounter [-] [81581] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=81581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:36.657876 dv-osbrick-master-4-iscsi devstack@keystone.service[81582]: DEBUG dbcounter [-] [81582] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:47.022282 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Authenticating user token {{(pid=81581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:47.024462 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:47.118081 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e60dab-5939-43f0-bc3e-059f01cf8e2b admin admin] Validating token access rules against request {{(pid=81581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:47.218743 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f469f-32ff-47ee-88a0-e7374f23df3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71de6ef4ed504cfe8289c8ec519405bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83e2a814cb694514a265b38274222c25', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:47.219820 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f469f-32ff-47ee-88a0-e7374f23df3e service placement] REQUEST_METHOD: `GET` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:47.220389 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f469f-32ff-47ee-88a0-e7374f23df3e service placement] SCRIPT_NAME: `/identity` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:47.220784 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f469f-32ff-47ee-88a0-e7374f23df3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:47.223882 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.fernet_utils [None req-649f469f-32ff-47ee-88a0-e7374f23df3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:47.245928 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f469f-32ff-47ee-88a0-e7374f23df3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:47.248904 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f469f-32ff-47ee-88a0-e7374f23df3e service placement] RBAC: Authorization granted {{(pid=81581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:47.269374 dv-osbrick-master-4-iscsi devstack@keystone.service[81581]: [pid: 81581|app: 0|req: 833/1661] 10.222.0.58 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)